Nov 03 07:23:00 devstack cinder-volume[75378]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:23:00 devstack cinder-volume[75378]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:23:00 devstack cinder-volume[75378]: we strongly recommend against using it for new projects. Nov 03 07:23:00 devstack cinder-volume[75378]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:23:00 devstack cinder-volume[75378]: framework. For more detail see Nov 03 07:23:00 devstack cinder-volume[75378]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:23:00 devstack cinder-volume[75378]: import eventlet # noqa Nov 03 07:23:03 devstack cinder-volume[75378]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:23:03 devstack cinder-volume[75378]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:23:03 devstack cinder-volume[75378]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:23:04 devstack cinder-volume[75378]: INFO dbcounter [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Registered counter for database cinder Nov 03 07:23:04 devstack cinder-volume[75378]: DEBUG oslo_db.sqlalchemy.engines [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:23:04 devstack cinder-volume[75378]: DEBUG dbcounter [-] [75378] Writer thread running {{(pid=75378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:23:04 devstack cinder-volume[75378]: INFO cinder.rpc [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:23:04 devstack cinder-volume[75378]: INFO cinder.rpc [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:23:04 devstack cinder-volume[75378]: DEBUG oslo_db.sqlalchemy.engines [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:23:04 devstack cinder-volume[75378]: INFO cinder.volume.manager [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Determined volume DB was empty at startup. Nov 03 07:23:04 devstack cinder-volume[75378]: DEBUG cinder.volume.manager [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75378) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:23:05 devstack cinder-volume[75378]: INFO cinder.volume.manager [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 07:23:05 devstack cinder-volume[75378]: WARNING stevedore.named [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:23:05 devstack cinder-volume[75378]: WARNING castellan.key_manager [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:23:05 devstack cinder-volume[75378]: WARNING cinder.keymgr.conf_key_mgr [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG cinder.volume.drivers.lvm [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75378) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_concurrency.processutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_concurrency.processutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.506s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_db.sqlalchemy.engines [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:23:05 devstack cinder-volume[75378]: INFO cinder.rpc [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 07:23:05 devstack cinder-volume[75378]: INFO cinder.rpc [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 07:23:05 devstack cinder-volume[75378]: WARNING stevedore.named [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:23:05 devstack cinder-volume[75378]: WARNING castellan.key_manager [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:23:05 devstack cinder-volume[75378]: INFO cinder.volume.manager [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_db.sqlalchemy.engines [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:23:05 devstack cinder-volume[75378]: INFO oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Starting 1 workers Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Started child 75540 {{(pid=75378) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Full set of CONF: {{(pid=75378) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] ******************************************************************************** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Configuration options gathered from: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] ================================================================================ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] allow_availability_zone_fallback = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] allow_compression_on_image_upload = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] allowed_direct_url_schemes = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] api_rate_limit = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] auth_strategy = keystone {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] az_cache_duration = 3600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_availability_zone = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_host = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_stats_polling_interval = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backup_api_class = cinder.backup.api.API {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backup_name_template = backup-%s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backup_use_same_host = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backup_use_temp_snapshot = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] chap_password = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] chap_username = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75540]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_internal_tenant_project_id = 1e25ab730c0b447099da1d0f951b8f56 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_internal_tenant_user_id = 66a44b095cea40b7845b10845ac5c4b0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cloned_volume_same_az = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cluster = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] compression_format = gzip {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] config_dir = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] config_source = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] control_exchange = openstack {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] debug = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] default_availability_zone = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] default_group_type = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] default_volume_type = lvmdriver-1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] disk_geometry = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] driver_client_cert = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] driver_client_cert_key = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] driver_data_namespace = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] driver_ssl_cert_path = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] driver_ssl_cert_verify = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] driver_use_ssl = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] enable_force_upload = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] enable_new_services = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] enable_unsupported_driver = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] enforce_multipath_for_image_xfer = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] filter_function = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_api_insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_api_servers = ['http://192.168.122.113/image'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_api_ssl_compression = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_ca_certificates_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_num_retries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance_request_timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] goodness_function = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] graceful_shutdown_timeout = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] group_api_class = cinder.group.api.API {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] host = devstack {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_compress_on_upload = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_conversion_address_space_limit = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_conversion_cpu_limit = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_conversion_disable = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_introspection_address_space_limit = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_introspection_cpu_limit = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_upload_use_cinder_backend = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_upload_use_internal_tenant = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_volume_cache_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_volume_cache_max_count = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] init_host_max_objects_retrieval = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] instance_format = [instance: %(uuid)s] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] iscsi_target_flags = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] iscsi_write_cache = on {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] iser_helper = tgtadm {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] iser_ip_address = 192.168.122.113 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] iser_port = 3260 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_color = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_config_append = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_dir = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_options = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_rotate_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_rotate_interval_type = days {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] log_rotation_type = none {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] max_age = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] max_logfile_count = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] max_logfile_size_mb = 200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] max_over_subscription_ratio = 20.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] message_reap_interval = 86400 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] message_ttl = 2592000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] monkey_patch = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] monkey_patch_modules = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] my_ip = 192.168.122.113 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] no_snapshot_gb_quota = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] num_iser_scan_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] num_shell_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] num_volume_device_scan_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] nvmeof_conn_info_version = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] nvmet_ns_id = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] nvmet_port_id = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_max_limit = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_volume_ext_list = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_volume_listen_port = 8776 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_volume_use_ssl = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] osapi_volume_workers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] per_volume_size_limit = -1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] periodic_fuzzy_delay = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] periodic_interval = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] public_endpoint = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] publish_errors = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_backup_gigabytes = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_backups = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_gigabytes = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_groups = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_snapshots = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] quota_volumes = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] rate_limit_burst = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] rate_limit_except_level = CRITICAL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] rate_limit_interval = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] reinit_driver_count = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] replication_device = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] report_discard_supported = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] report_interval = 120 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] reservation_clean_interval = 86400 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] reservation_expire = 86400 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] reserved_image_namespaces = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] reserved_percentage = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] rpc_response_timeout = 120 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] run_external_periodic_tasks = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] scst_target_driver = iscsi {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] scst_target_iqn_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_down_time = 720 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] shell_completion = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] snapshot_name_template = snapshot-%s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] snapshot_same_host = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] state_path = /opt/stack/data/cinder {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] storage_availability_zone = nova {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] storage_protocol = iSCSI {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75540]: INFO cinder.volume.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] syslog_log_facility = LOG_USER {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] target_helper = lioadm {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] target_ip_address = 192.168.122.113 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] target_port = 3260 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] target_protocol = iscsi {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] target_secondary_ip_addresses = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] trace_flags = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] transport_url = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] until_refresh = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_chap_auth = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_default_quota_class = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_journal = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_json = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_multipath_for_image_xfer = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_stderr = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] use_syslog = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] verify_glance_signatures = enabled {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_api_class = cinder.volume.api.API {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_backend_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_clear = zero {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_clear_ionice = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_clear_size = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_copy_bps_limit = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_dd_blocksize = 1M {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_name_template = volume-%s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_service_inithost_offload = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volume_usage_audit_period = month {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] zoning_mode = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.auth_section = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.auth_type = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.auth_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.cache = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.interface = public {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_password = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcache_username = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.region_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.service_type = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.113/identity {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.backend = dogpile.cache.null {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.backend_argument = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.backend_expiration_time = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.config_prefix = cache.oslo {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.debug_cache_backend = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.enable_retry_client = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.enable_socket_keepalive = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.expiration_time = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_dead_retry = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_sasl_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.password = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.proxies = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.redis_db = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.redis_server = localhost:6379 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.retry_attempts = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.retry_delay = 0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.socket_keepalive_count = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.socket_keepalive_idle = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.socket_keepalive_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.socket_timeout = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.tls_allowed_ciphers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.tls_cafile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.tls_certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.tls_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.tls_keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cache.username = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] coordination.backend_url = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.asyncio_connection = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.asyncio_slave_connection = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.backend = sqlalchemy {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.connection = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.connection_debug = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.connection_parameters = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.connection_recycle_time = 3600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.connection_trace = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.db_inc_retry_interval = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.db_max_retries = 20 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.db_max_retry_interval = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.db_retry_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.max_overflow = 50 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.max_pool_size = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.max_retries = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.pool_timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.retry_interval = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.slave_connection = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.sqlite_synchronous = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.synchronous_reader = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] database.use_db_reconnect = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_tracing.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.connection_string = messaging:// {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.es_doc_type = notification {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.es_scroll_size = 10000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.es_scroll_time = 2m {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.filter_error_trace = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.hmac_keys = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.sentinel_service_name = mymaster {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.socket_timeout = 0.1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.trace_requests = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler.trace_sqlalchemy = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler_jaeger.process_tags = {} {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] profiler_otlp.service_name_prefix = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.policy_default_rule = default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.group = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.helper_command = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] privsep_osbrick.user = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.group = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.helper_command = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] cinder_sys_admin.user = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.auth_section = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.auth_type = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.cafile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.collect_timing = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.send_service_user_token = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.tls_ciphers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] service_user.tls_min_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.auth_section = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.auth_type = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.collect_timing = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.region_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.tls_ciphers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] glance.tls_min_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.backend_availability_zone = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:05 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.chap_password = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.chap_username = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.disk_geometry = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.driver_client_cert = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.driver_data_namespace = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.driver_use_ssl = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.extra_capabilities = {} {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.filter_function = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.goodness_function = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.iscsi_target_flags = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.iser_port = 3260 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.lvm_share_target = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.lvm_type = auto {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.replication_device = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.report_discard_supported = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.target_helper = tgtadm {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.target_port = 3260 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack sudo[75544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.target_protocol = iscsi {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.trace_flags = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.use_chap_auth = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack sudo[75544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_backend_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_clear = zero {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_reports.file_event_handler = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_reports.log_dir = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.backend_host = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.chap_password = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.chap_username = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.disk_geometry = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.filter_function = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.goodness_function = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.iser_helper = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.iser_port = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.lvm_type = auto {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.replication_device = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.storage_protocol = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.target_ip_address = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.target_port = 3260 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.trace_flags = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_clear = zero {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] lvmdriver-1.volumes_dir = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_notifications.driver = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] key_manager.fixed_key = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.barbican_api_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.barbican_endpoint = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.barbican_endpoint_type = public {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.barbican_region_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.cafile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.collect_timing = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.number_of_retries = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.retry_delay = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.send_service_user_token = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.tls_ciphers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.tls_min_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.verify_ssl = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican.verify_ssl_path = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.auth_section = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.auth_type = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.cafile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.collect_timing = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.tls_ciphers = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] barbican_service_user.tls_min_version = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.approle_role_id = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.approle_secret_id = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.auth_method = approle {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.auth_path = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.kv_mountpoint = secret {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.kv_path = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.kv_version = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.namespace = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.root_token_id = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.ssl_ca_crt_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.timeout = 60.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.token_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.token_role = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.use_ssl = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:23:06 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] ******************************************************************************** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:23:06 devstack sudo[75544]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.384s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:06 devstack sudo[75547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:06 devstack sudo[75547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:06 devstack sudo[75547]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.342s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:23:06 devstack cinder-volume[75540]: INFO cinder.brick.local_dev.lvm [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:06 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:06 devstack sudo[75631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:06 devstack sudo[75631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:07 devstack sudo[75631]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG cinder.brick.local_dev.lvm [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75540) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:07 devstack sudo[75719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:07 devstack sudo[75719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:07 devstack sudo[75719]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:07 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:07 devstack sudo[75926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:07 devstack sudo[75926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:08 devstack sudo[75926]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:08 devstack sudo[76020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 07:23:08 devstack sudo[76020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:08 devstack sudo[76020]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.292s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:08 devstack sudo[76131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:08 devstack sudo[76131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:08 devstack sudo[76131]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:08 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:08 devstack sudo[76161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:08 devstack sudo[76161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:09 devstack sudo[76161]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.370s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:09 devstack sudo[76245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:09 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:09 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:09 devstack sudo[76248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:09 devstack sudo[76248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:09 devstack sudo[76248]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:09 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:09 devstack sudo[76316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:09 devstack sudo[76316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:10 devstack sudo[76316]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.358s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:10 devstack cinder-volume[75540]: INFO cinder.volume.drivers.lvm [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:10 devstack sudo[76342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:10 devstack sudo[76342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:10 devstack sudo[76342]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:10 devstack sudo[76352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:10 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:10 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:10 devstack sudo[76355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:10 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:10 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:10 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:10 devstack sudo[76358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:10 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:11 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:11 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:11 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:11 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:11 devstack cinder-volume[75540]: INFO cinder.volume.driver [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG cinder.volume.driver [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75540) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_db.sqlalchemy.engines [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writer thread running {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG cinder.db.api [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Building query based on filter {{(pid=75540) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG cinder.image.image_utils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75540) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:23:11 devstack cinder-volume[75540]: INFO cinder.keymgr.migration [None req-0903df88-2f1a-4396-9816-7b187e8e1ada None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:11 devstack sudo[76365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:11 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:11 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:11 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:11 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:11 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:12 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:12 devstack sudo[76374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:12 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:12 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:12 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:12 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:12 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG cinder.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Notifying Schedulers of capabilities ... {{(pid=75540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:23:12 devstack cinder-volume[75540]: INFO cinder.volume.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Driver initialization completed successfully. Nov 03 07:23:12 devstack cinder-volume[75540]: INFO cinder.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Initiating service 2 cleanup Nov 03 07:23:12 devstack cinder-volume[75540]: INFO cinder.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Service 2 cleanup completed. Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG cinder.service [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Creating RPC server for service cinder-volume {{(pid=75540) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:23:12 devstack cinder-volume[75540]: DEBUG cinder.service [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75540) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:23:13 devstack cinder-volume[75540]: INFO cinder.volume.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 07:23:13 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:23:13 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:13 devstack sudo[76382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:13 devstack sudo[76382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:13 devstack sudo[76382]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:13 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:13 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:13 devstack sudo[76385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:13 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:13 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:13 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:13 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:13 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:13 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:14 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:14 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.382s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:14 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:14 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:14 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:14 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:14 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:14 devstack cinder-volume[75540]: INFO cinder.volume.manager [None req-7664c0e6-ee29-4370-bc07-36bf10af473e None None] Driver post RPC initialization completed successfully. Nov 03 07:23:15 devstack cinder-volume[75378]: DEBUG dbcounter [-] [75378] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:23:24 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writing DB stats cinder:SELECT=3 {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:23:24 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:23:37 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager._thread_info {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:23:37 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread count: 6 {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:23:37 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread info: [<_MainThread(MainThread, started 132389722566784)>, , , , , ] {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:24:37 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:24:37 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:24:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:37 devstack sudo[78925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:24:37 devstack sudo[78925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:37 devstack sudo[78925]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:37 devstack sudo[78928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:24:37 devstack sudo[78928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:38 devstack sudo[78928]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.387s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:38 devstack sudo[78931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:24:38 devstack sudo[78931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:38 devstack sudo[78931]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:38 devstack sudo[78934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:24:38 devstack sudo[78934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:38 devstack sudo[78934]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG cinder.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Notifying Schedulers of capabilities ... {{(pid=75540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager._thread_info {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread count: 6 {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:24:38 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread info: [<_MainThread(MainThread, started 132389722566784)>, , , , , ] {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:25:24 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writing DB stats cinder:SELECT=1 {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:24 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writing DB stats cinder:UPDATE=1 {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:37 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:25:37 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:25:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:37 devstack sudo[82213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:25:37 devstack sudo[82213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:37 devstack sudo[82213]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:37 devstack sudo[82216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:25:37 devstack sudo[82216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:38 devstack sudo[82216]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:38 devstack sudo[82219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:25:38 devstack sudo[82219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:38 devstack sudo[82219]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:38 devstack sudo[82223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:25:38 devstack sudo[82223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:38 devstack sudo[82223]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:38 devstack cinder-volume[75540]: DEBUG cinder.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Notifying Schedulers of capabilities ... {{(pid=75540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:26:37 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:26:37 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:26:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:37 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:26:37 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:37 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:37 devstack sudo[84286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:26:37 devstack sudo[84286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:38 devstack sudo[84286]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:38 devstack sudo[84302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:26:38 devstack sudo[84302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:38 devstack sudo[84302]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:38 devstack sudo[84314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:26:38 devstack sudo[84314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:38 devstack sudo[84314]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG cinder.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Notifying Schedulers of capabilities ... {{(pid=75540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager._thread_info {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread count: 6 {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:26:38 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread info: [<_MainThread(MainThread, started 132389722566784)>, , , , , ] {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:27:24 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writing DB stats cinder:SELECT=1 {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:24 devstack cinder-volume[75540]: DEBUG dbcounter [-] [75540] Writing DB stats cinder:UPDATE=1 {{(pid=75540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:37 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:27:37 devstack cinder-volume[75540]: DEBUG cinder.volume.drivers.lvm [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Updating volume stats {{(pid=75540) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:27:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:37 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:27:37 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:37 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:37 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:37 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:27:37 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:38 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:38 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:27:38 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:38 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:38 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:27:38 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:38 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG oslo_concurrency.processutils [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG cinder.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Notifying Schedulers of capabilities ... {{(pid=75540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG oslo_service.periodic_task [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] Running periodic task VolumeManager._thread_info {{(pid=75540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread count: 6 {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:27:38 devstack cinder-volume[75540]: DEBUG cinder.volume.manager [None req-ebd0f973-9f36-443d-93c1-56e28dd8daef None None] thread info: [<_MainThread(MainThread, started 132389722566784)>, , , , , ] {{(pid=75540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:28:10 devstack cinder-volume[75378]: INFO oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Caught SIGTERM, stopping children Nov 03 07:28:10 devstack cinder-volume[75378]: DEBUG oslo_concurrency.lockutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Acquiring lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:28:10 devstack cinder-volume[75378]: DEBUG oslo_concurrency.lockutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Acquired lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:28:10 devstack cinder-volume[75378]: DEBUG oslo_concurrency.lockutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Releasing lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:28:10 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Stop services. {{(pid=75378) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 07:28:10 devstack cinder-volume[75378]: DEBUG oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Killing children. {{(pid=75378) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 07:28:10 devstack cinder-volume[75378]: INFO oslo_service.backend._eventlet.service [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Waiting on 1 children to exit Nov 03 07:28:15 devstack cinder-volume[75540]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 03 07:28:16 devstack cinder-volume[86055]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:28:16 devstack cinder-volume[86055]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:28:16 devstack cinder-volume[86055]: we strongly recommend against using it for new projects. Nov 03 07:28:16 devstack cinder-volume[86055]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:28:16 devstack cinder-volume[86055]: framework. For more detail see Nov 03 07:28:16 devstack cinder-volume[86055]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:28:16 devstack cinder-volume[86055]: import eventlet # noqa Nov 03 07:28:18 devstack cinder-volume[75540]: DEBUG oslo_concurrency.lockutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Acquiring lock "singleton_lock" {{(pid=75540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:28:18 devstack cinder-volume[75540]: DEBUG oslo_concurrency.lockutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Acquired lock "singleton_lock" {{(pid=75540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:28:18 devstack cinder-volume[75540]: DEBUG oslo_concurrency.lockutils [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Releasing lock "singleton_lock" {{(pid=75540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:28:18 devstack cinder-volume[75540]: WARNING amqp [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:28:18 devstack cinder-volume[75540]: WARNING amqp [None req-35ffdbbc-04ef-4535-bc64-beead4b492f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:28:18 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:28:18 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:28:18 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:28:19 devstack cinder-volume[86055]: INFO dbcounter [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Registered counter for database cinder Nov 03 07:28:19 devstack cinder-volume[86055]: DEBUG oslo_db.sqlalchemy.engines [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:19 devstack cinder-volume[86055]: DEBUG dbcounter [-] [86055] Writer thread running {{(pid=86055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:28:19 devstack cinder-volume[86055]: INFO cinder.rpc [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:28:19 devstack cinder-volume[86055]: INFO cinder.rpc [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:28:19 devstack cinder-volume[86055]: DEBUG oslo_db.sqlalchemy.engines [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:19 devstack cinder-volume[86055]: INFO cinder.volume.manager [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Determined volume DB was empty at startup. Nov 03 07:28:19 devstack cinder-volume[86055]: DEBUG cinder.volume.manager [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86055) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:28:19 devstack cinder-volume[86055]: INFO cinder.volume.manager [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 07:28:19 devstack cinder-volume[86055]: WARNING stevedore.named [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:28:19 devstack cinder-volume[86055]: WARNING castellan.key_manager [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:28:19 devstack cinder-volume[86055]: WARNING cinder.keymgr.conf_key_mgr [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:28:19 devstack cinder-volume[86055]: INFO cinder.volume.manager [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 07:28:19 devstack cinder-volume[86055]: DEBUG oslo_db.sqlalchemy.engines [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:20 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Starting 1 workers Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Started child 86273 {{(pid=86055) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Full set of CONF: {{(pid=86055) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] ******************************************************************************** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Configuration options gathered from: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] ================================================================================ {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] allow_availability_zone_fallback = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] allow_compression_on_image_upload = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] allowed_direct_url_schemes = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] api_rate_limit = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] auth_strategy = keystone {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_host = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_stats_polling_interval = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backup_api_class = cinder.backup.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backup_name_template = backup-%s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backup_use_same_host = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backup_use_temp_snapshot = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] chap_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] chap_username = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_internal_tenant_project_id = 1e25ab730c0b447099da1d0f951b8f56 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_internal_tenant_user_id = 66a44b095cea40b7845b10845ac5c4b0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cluster = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86273]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] compression_format = gzip {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] compute_api_class = cinder.compute.nova.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] config_dir = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] config_source = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] control_exchange = openstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] debug = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] default_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] default_group_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] default_volume_type = QuobyteHD {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] disk_geometry = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] driver_client_cert = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] driver_client_cert_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] driver_data_namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] driver_ssl_cert_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] driver_ssl_cert_verify = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] driver_use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] enable_new_services = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] enable_unsupported_driver = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] enabled_backends = ['QuobyteHD'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] enforce_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] filter_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_api_insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_api_servers = ['http://192.168.122.113/image'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_api_ssl_compression = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_ca_certificates_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_catalog_info = image:glance:publicURL {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_num_retries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance_request_timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] goodness_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] graceful_shutdown_timeout = 5 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] group_api_class = cinder.group.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] host = devstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_compress_on_upload = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_conversion_address_space_limit = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_conversion_cpu_limit = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_conversion_disable = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_introspection_address_space_limit = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_introspection_cpu_limit = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_upload_use_cinder_backend = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_upload_use_internal_tenant = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_volume_cache_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_volume_cache_max_count = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] image_volume_cache_max_size_gb = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] init_host_max_objects_retrieval = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] instance_format = [instance: %(uuid)s] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] iscsi_target_flags = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] iscsi_write_cache = on {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] iser_helper = tgtadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] iser_ip_address = 192.168.122.113 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] iser_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_color = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_config_append = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_dir = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_options = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_rotate_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_rotate_interval_type = days {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] log_rotation_type = none {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] max_age = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] max_logfile_count = 30 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] max_logfile_size_mb = 200 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] max_over_subscription_ratio = 20.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] message_reap_interval = 86400 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] message_ttl = 2592000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] migration_create_volume_timeout_secs = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] monkey_patch = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] monkey_patch_modules = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] my_ip = 192.168.122.113 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] no_snapshot_gb_quota = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] num_iser_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] num_shell_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] num_volume_device_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] nvmeof_conn_info_version = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] nvmet_ns_id = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] nvmet_port_id = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_max_limit = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_volume_ext_list = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_volume_listen_port = 8776 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_volume_use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] osapi_volume_workers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.remotefs [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86273) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] per_volume_size_limit = -1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] periodic_fuzzy_delay = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] periodic_interval = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] public_endpoint = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] publish_errors = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_backup_gigabytes = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_backups = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_gigabytes = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_groups = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_snapshots = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] quota_volumes = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] rate_limit_burst = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] rate_limit_except_level = CRITICAL {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] rate_limit_interval = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] reinit_driver_count = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] replication_device = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] report_discard_supported = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] report_interval = 120 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] reservation_clean_interval = 86400 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] reservation_expire = 86400 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] reserved_image_namespaces = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] reserved_percentage = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] rpc_response_timeout = 120 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] run_external_periodic_tasks = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] scst_target_driver = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] scst_target_iqn_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_down_time = 720 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] shell_completion = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] snapshot_name_template = snapshot-%s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] state_path = /opt/stack/data/cinder {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] storage_availability_zone = nova {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] storage_protocol = iSCSI {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] syslog_log_facility = LOG_USER {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] target_helper = lioadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] target_ip_address = 192.168.122.113 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] target_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] target_protocol = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] target_secondary_ip_addresses = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] trace_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] transport_url = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] until_refresh = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_chap_auth = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_default_quota_class = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_journal = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_json = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_stderr = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] use_syslog = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] verify_glance_signatures = enabled {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_api_class = cinder.volume.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_backend_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_clear = zero {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_clear_ionice = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_clear_size = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_copy_bps_limit = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_dd_blocksize = 1M {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_name_template = volume-%s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_service_inithost_offload = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volume_usage_audit_period = month {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] zoning_mode = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_concurrency.disable_process_locking = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.auth_type = password {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.auth_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.cache = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.include_service_catalog = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.interface = public {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcache_username = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.region_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.service_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.113/identity {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.backend = dogpile.cache.null {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.backend_argument = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.backend_expiration_time = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.config_prefix = cache.oslo {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.debug_cache_backend = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.enable_retry_client = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.enable_socket_keepalive = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.expiration_time = 600 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.hashclient_retry_attempts = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_dead_retry = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_pool_maxsize = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_sasl_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.proxies = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86273) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 07:28:20 devstack cinder-volume[86273]: WARNING cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.redis_db = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.redis_server = localhost:6379 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.retry_attempts = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.retry_delay = 0.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86273]: WARNING cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Running cmd (subprocess): mount.quobyte {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.socket_keepalive_count = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.socket_keepalive_idle = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.socket_keepalive_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.socket_timeout = 1.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.tls_allowed_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.tls_cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.tls_certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.tls_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.tls_keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cache.username = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] coordination.backend_url = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.asyncio_connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.asyncio_slave_connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.backend = sqlalchemy {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.connection_debug = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.connection_parameters = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.connection_recycle_time = 3600 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.connection_trace = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.db_inc_retry_interval = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.db_max_retries = 20 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.db_max_retry_interval = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.db_retry_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.max_overflow = 50 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.max_pool_size = 5 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.max_retries = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.mysql_wsrep_sync_wait = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.pool_timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.retry_interval = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.slave_connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.sqlite_synchronous = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.synchronous_reader = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] database.use_db_reconnect = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_tracing.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.connection_string = messaging:// {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.es_doc_type = notification {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.es_scroll_size = 10000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.es_scroll_time = 2m {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.filter_error_trace = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.hmac_keys = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.sentinel_service_name = mymaster {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.socket_timeout = 0.1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.trace_requests = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler.trace_sqlalchemy = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler_jaeger.process_tags = {} {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler_jaeger.service_name_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] profiler_otlp.service_name_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.enforce_new_defaults = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.policy_default_rule = default {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.policy_file = policy.yaml {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.group = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.helper_command = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] privsep_osbrick.user = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.group = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.helper_command = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] cinder_sys_admin.user = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.auth_type = password {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.send_service_user_token = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] service_user.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.auth_type = password {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.region_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] glance.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.backend_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86273]: INFO cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 ... Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.chap_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a -c /etc/quobyte/client-cinder.cfg {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.chap_username = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.disk_geometry = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.driver_client_cert = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.driver_client_cert_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.driver_data_namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.driver_use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.extra_capabilities = {} {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.filter_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.goodness_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.iscsi_target_flags = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.iscsi_write_cache = on {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.iser_helper = tgtadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.iser_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_host = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_login = admin {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_mount_options = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a -c /etc/quobyte/client-cinder.cfg Nov 03 07:28:20 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_private_key = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_share_path = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.num_shell_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.quobyte_volume_url = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.replication_device = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.report_discard_supported = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.reserved_percentage = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.target_helper = tgtadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.target_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.target_protocol = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.trace_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.unique_fqdn_network = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.use_chap_auth = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_backend_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_clear = zero {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_clear_ionice = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_clear_size = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_reports.file_event_handler = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_reports.log_dir = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.backend_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.backend_host = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.chap_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.chap_username = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.chiscsi_conf = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.disk_geometry = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.driver_client_cert = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.driver_data_namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.driver_use_ssl = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.extra_capabilities = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.filter_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.goodness_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.iser_helper = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.iser_ip_address = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.iser_port = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.iser_target_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_host = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_login = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_mount_options = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_private_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_share_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_ssh_port = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.num_shell_tries = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.nvmet_port_id = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.replication_device = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.report_discard_supported = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.reserved_percentage = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.scst_target_driver = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.storage_protocol = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.target_helper = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.target_ip_address = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.target_port = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.target_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.target_protocol = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.trace_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.use_chap_auth = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_clear = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_clear_size = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] QuobyteHD.volumes_dir = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_notifications.driver = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_notifications.retry = -1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] key_manager.fixed_key = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.barbican_api_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.barbican_endpoint = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.barbican_endpoint_type = public {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.barbican_region_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.number_of_retries = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.retry_delay = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.send_service_user_token = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.verify_ssl = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican.verify_ssl_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.auth_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] barbican_service_user.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.approle_role_id = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.approle_secret_id = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.auth_method = approle {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.auth_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.kv_mountpoint = secret {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.kv_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.kv_version = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.root_token_id = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.ssl_ca_crt_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.timeout = 60.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.token_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.token_role = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:20 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] ******************************************************************************** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:28:20 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.498s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:20 devstack cinder-volume[86273]: INFO cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 succeeded Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.510s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:20 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:20 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:20 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:21 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.272s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:21 devstack cinder-volume[86273]: INFO cinder.volume.driver [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.volume.driver [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7374992370605, 'free_capacity_gb': 1773.7374992370605, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86273) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG dbcounter [-] [86273] Writer thread running {{(pid=86273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.db.api [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Building query based on filter {{(pid=86273) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.image.image_utils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86273) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:28:21 devstack cinder-volume[86273]: INFO cinder.keymgr.migration [None req-1df9e2e5-c7bd-47f4-a22d-647e974cd485 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:21 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:21 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:21 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.275s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Notifying Schedulers of capabilities ... {{(pid=86273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:21 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Driver initialization completed successfully. Nov 03 07:28:21 devstack cinder-volume[86273]: INFO cinder.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Initiating service 3 cleanup Nov 03 07:28:21 devstack cinder-volume[86273]: INFO cinder.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Service 3 cleanup completed. Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.service [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Creating RPC server for service cinder-volume {{(pid=86273) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.service [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86273) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:28:21 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:21 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:21 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:21 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:22 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:22 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.326s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:22 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-885e5184-7153-46a2-8cb4-b555a7615e0c None None] Driver post RPC initialization completed successfully. Nov 03 07:28:26 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:26 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:26 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:26 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:26 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:26 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:26 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:26 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:27 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:27 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.255s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:27 devstack cinder-volume[86273]: DEBUG cinder.manager [None req-c0a180a7-f925-48ca-9a9e-4b802de29f22 None None] Notifying Schedulers of capabilities ... {{(pid=86273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:28 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Caught SIGTERM, stopping children Nov 03 07:28:28 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Acquiring lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:28:28 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Acquired lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:28:28 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Releasing lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:28:28 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Stop services. {{(pid=86055) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 07:28:28 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Killing children. {{(pid=86055) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 07:28:28 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Waiting on 1 children to exit Nov 03 07:28:29 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Acquiring lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:28:29 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Acquired lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:28:29 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Releasing lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:28:29 devstack cinder-volume[86273]: WARNING amqp [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:28:29 devstack cinder-volume[86273]: WARNING amqp [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:28:30 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-65b104b4-a263-4f6c-9ac0-d582817f8565 None None] Child 86273 exited with status 0 Nov 03 07:28:30 devstack cinder-volume[86589]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:28:30 devstack cinder-volume[86589]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:28:30 devstack cinder-volume[86589]: we strongly recommend against using it for new projects. Nov 03 07:28:30 devstack cinder-volume[86589]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:28:30 devstack cinder-volume[86589]: framework. For more detail see Nov 03 07:28:30 devstack cinder-volume[86589]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:28:30 devstack cinder-volume[86589]: import eventlet # noqa Nov 03 07:28:33 devstack cinder-volume[86589]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:28:33 devstack cinder-volume[86589]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:28:33 devstack cinder-volume[86589]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:28:35 devstack cinder-volume[86589]: INFO dbcounter [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Registered counter for database cinder Nov 03 07:28:35 devstack cinder-volume[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-8134de7d-a121-4612-842a-f27e76082aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:35 devstack cinder-volume[86589]: DEBUG dbcounter [-] [86589] Writer thread running {{(pid=86589) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:28:35 devstack cinder-volume[86589]: INFO cinder.rpc [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:28:35 devstack cinder-volume[86589]: INFO cinder.rpc [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:28:35 devstack cinder-volume[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-8134de7d-a121-4612-842a-f27e76082aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:35 devstack cinder-volume[86589]: INFO cinder.volume.manager [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Determined volume DB was empty at startup. Nov 03 07:28:35 devstack cinder-volume[86589]: DEBUG cinder.volume.manager [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86589) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:28:36 devstack cinder-volume[86589]: WARNING stevedore.named [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:28:36 devstack cinder-volume[86589]: WARNING castellan.key_manager [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:28:36 devstack cinder-volume[86589]: WARNING cinder.keymgr.conf_key_mgr [None req-8134de7d-a121-4612-842a-f27e76082aca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:28:36 devstack cinder-volume[86589]: INFO cinder.volume.manager [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-8134de7d-a121-4612-842a-f27e76082aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:36 devstack cinder-volume[86589]: INFO oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Starting 1 workers Nov 03 07:28:36 devstack cinder-volume[86916]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Started child 86916 {{(pid=86589) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Full set of CONF: {{(pid=86589) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] ******************************************************************************** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] Configuration options gathered from: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] ================================================================================ {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] allow_availability_zone_fallback = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] allow_compression_on_image_upload = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] allowed_direct_url_schemes = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] api_rate_limit = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] auth_strategy = keystone {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_host = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_stats_polling_interval = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backup_api_class = cinder.backup.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backup_name_template = backup-%s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backup_use_same_host = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backup_use_temp_snapshot = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] chap_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] chap_username = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_internal_tenant_project_id = 1e25ab730c0b447099da1d0f951b8f56 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_internal_tenant_user_id = 66a44b095cea40b7845b10845ac5c4b0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cluster = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] compression_format = gzip {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] compute_api_class = cinder.compute.nova.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] config_dir = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] config_source = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] control_exchange = openstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] debug = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] default_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] default_group_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] default_volume_type = QuobyteHD {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] disk_geometry = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] driver_client_cert = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] driver_client_cert_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] driver_data_namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] driver_ssl_cert_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] driver_ssl_cert_verify = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] driver_use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] enable_new_services = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] enable_unsupported_driver = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] enabled_backends = ['QuobyteHD'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] enforce_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] filter_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_api_insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_api_servers = ['http://192.168.122.113/image'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_api_ssl_compression = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_ca_certificates_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_catalog_info = image:glance:publicURL {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_num_retries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance_request_timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] goodness_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] graceful_shutdown_timeout = 5 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] group_api_class = cinder.group.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] host = devstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_compress_on_upload = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_conversion_address_space_limit = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_conversion_cpu_limit = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_conversion_disable = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86916) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_introspection_address_space_limit = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_introspection_cpu_limit = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_upload_use_cinder_backend = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_upload_use_internal_tenant = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_volume_cache_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_volume_cache_max_count = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] image_volume_cache_max_size_gb = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] init_host_max_objects_retrieval = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] instance_format = [instance: %(uuid)s] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] iscsi_target_flags = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] iscsi_write_cache = on {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] iser_helper = tgtadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] iser_ip_address = 192.168.122.113 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] iser_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_color = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_config_append = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_dir = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_options = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_rotate_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_rotate_interval_type = days {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] log_rotation_type = none {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] max_age = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] max_logfile_count = 30 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] max_logfile_size_mb = 200 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] max_over_subscription_ratio = 20.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] message_reap_interval = 86400 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] message_ttl = 2592000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] migration_create_volume_timeout_secs = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] monkey_patch = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] monkey_patch_modules = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] my_ip = 192.168.122.113 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] no_snapshot_gb_quota = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] num_iser_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] num_shell_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] num_volume_device_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] nvmeof_conn_info_version = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] nvmet_ns_id = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] nvmet_port_id = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_max_limit = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_volume_ext_list = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_volume_listen = 0.0.0.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_volume_listen_port = 8776 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_volume_use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] osapi_volume_workers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] per_volume_size_limit = -1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] periodic_fuzzy_delay = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] periodic_interval = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] project_id_regex = [0-9a-f\-]+ {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] public_endpoint = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] publish_errors = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_backup_gigabytes = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_backups = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_gigabytes = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_groups = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_snapshots = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] quota_volumes = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] rate_limit_burst = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] rate_limit_except_level = CRITICAL {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] rate_limit_interval = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] reinit_driver_count = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] replication_device = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] report_discard_supported = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] report_interval = 120 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] reservation_clean_interval = 86400 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] reservation_expire = 86400 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] reserved_image_namespaces = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] reserved_percentage = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] rpc_response_timeout = 120 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] run_external_periodic_tasks = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] scst_target_driver = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] scst_target_iqn_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_down_time = 720 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] shell_completion = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] snapshot_name_template = snapshot-%s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] state_path = /opt/stack/data/cinder {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] storage_availability_zone = nova {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] storage_protocol = iSCSI {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] syslog_log_facility = LOG_USER {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] target_helper = lioadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] target_ip_address = 192.168.122.113 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] target_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] target_protocol = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] target_secondary_ip_addresses = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] trace_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] transfer_api_class = cinder.transfer.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] transport_url = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] until_refresh = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_chap_auth = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_default_quota_class = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_journal = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_json = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_stderr = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] use_syslog = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] verify_glance_signatures = enabled {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_api_class = cinder.volume.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_backend_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_clear = zero {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_clear_ionice = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_clear_size = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_copy_bps_limit = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_dd_blocksize = 1M {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_name_template = volume-%s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_service_inithost_offload = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volume_usage_audit_period = month {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] zoning_mode = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_concurrency.disable_process_locking = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.auth_type = password {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.auth_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.cache = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.delay_auth_decision = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.http_connect_timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.include_service_catalog = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.interface = public {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcache_username = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.region_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.service_token_roles_required = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.service_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.token_cache_time = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.113/identity {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.backend = dogpile.cache.null {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.backend_argument = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.backend_expiration_time = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.config_prefix = cache.oslo {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.debug_cache_backend = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.enable_retry_client = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.enable_socket_keepalive = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.expiration_time = 600 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.hashclient_retry_attempts = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_dead_retry = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_pool_maxsize = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_sasl_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.proxies = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.redis_db = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.redis_sentinel_service_name = mymaster {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.redis_server = localhost:6379 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.retry_attempts = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.retry_delay = 0.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.socket_keepalive_count = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.socket_keepalive_idle = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.socket_keepalive_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.socket_timeout = 1.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.tls_allowed_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.tls_cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.tls_certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.tls_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.tls_keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cache.username = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] coordination.backend_url = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.asyncio_connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.asyncio_slave_connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.backend = sqlalchemy {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.connection_debug = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.connection_parameters = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.connection_recycle_time = 3600 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.connection_trace = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.db_inc_retry_interval = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.db_max_retries = 20 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.db_max_retry_interval = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.db_retry_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.max_overflow = 50 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.max_pool_size = 5 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.max_retries = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.mysql_wsrep_sync_wait = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.pool_timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.retry_interval = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.slave_connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.sqlite_synchronous = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.synchronous_reader = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86916) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 07:28:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] database.use_db_reconnect = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_tracing.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Running cmd (subprocess): mount.quobyte {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.connection_string = messaging:// {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.es_doc_type = notification {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.es_scroll_size = 10000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.es_scroll_time = 2m {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.filter_error_trace = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.hmac_keys = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.sentinel_service_name = mymaster {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.socket_timeout = 0.1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.trace_requests = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler.trace_sqlalchemy = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler_jaeger.process_tags = {} {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler_jaeger.service_name_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] profiler_otlp.service_name_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.enforce_new_defaults = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.policy_default_rule = default {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.policy_file = policy.yaml {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_policy.remote_timeout = 60.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.group = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.helper_command = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] privsep_osbrick.user = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.group = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.helper_command = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] cinder_sys_admin.user = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.auth_type = password {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.send_service_user_token = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] service_user.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.auth_type = password {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:36 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.region_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] glance.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.backend_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.chap_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.chap_username = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.disk_geometry = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.driver_client_cert = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.driver_client_cert_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.driver_data_namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.driver_use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.enable_unsupported_driver = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.extra_capabilities = {} {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.filter_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.goodness_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.iscsi_target_flags = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.iscsi_write_cache = on {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.iser_helper = tgtadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.iser_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_host = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_login = admin {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_mount_options = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_private_key = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_share_path = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_ssh_port = 22 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.num_shell_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.nvmet_port_id = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_client_cfg = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.quobyte_volume_url = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.replication_device = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.report_discard_supported = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.reserved_percentage = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.scst_target_driver = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.scst_target_iqn_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.storage_protocol = iSCSI {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.target_helper = tgtadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.target_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.target_protocol = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.trace_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.unique_fqdn_network = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.use_chap_auth = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_backend_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_clear = zero {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_clear_ionice = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_clear_size = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] CMD "mount.quobyte" returned: 1 in 0.174s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_reports.file_event_handler = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_reports.log_dir = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.backend_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.backend_host = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.chap_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.chap_username = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.chiscsi_conf = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.disk_geometry = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.driver_client_cert = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.driver_client_cert_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.driver_data_namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.driver_use_ssl = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.extra_capabilities = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.filter_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.goodness_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.iscsi_target_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.iscsi_write_cache = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.iser_helper = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.iser_ip_address = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.iser_port = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.iser_target_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_host = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_login = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_mount_options = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_private_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_share_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_ssh_port = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.num_shell_tries = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nvmet_ns_id = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.nvmet_port_id = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.replication_device = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.report_discard_supported = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.reserved_percentage = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.scst_target_driver = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.storage_protocol = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.target_helper = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.target_ip_address = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.target_port = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.target_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.target_protocol = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.trace_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.unique_fqdn_network = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.use_chap_auth = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_clear = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_clear_ionice = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_clear_size = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] QuobyteHD.volumes_dir = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.ssl_version = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_notifications.driver = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_notifications.retry = -1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] oslo_messaging_notifications.transport_url = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] key_manager.fixed_key = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.barbican_api_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.barbican_endpoint = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.barbican_endpoint_type = public {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.barbican_region_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.number_of_retries = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.retry_delay = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.send_service_user_token = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.verify_ssl = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican.verify_ssl_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.auth_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] barbican_service_user.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.approle_role_id = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.approle_secret_id = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.auth_method = approle {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.auth_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.kv_mountpoint = secret {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.kv_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.kv_version = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.root_token_id = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.ssl_ca_crt_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.timeout = 60.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.token_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.token_role = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:28:37 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-8134de7d-a121-4612-842a-f27e76082aca None None] ******************************************************************************** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:28:37 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.589s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:37 devstack cinder-volume[86916]: INFO cinder.volume.driver [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.driver [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7365684509277, 'free_capacity_gb': 1773.7365684509277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_db.sqlalchemy.engines [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writer thread running {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.db.api [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Building query based on filter {{(pid=86916) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86916) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:37 devstack cinder-volume[86916]: INFO cinder.keymgr.migration [None req-fae53c6d-c7d6-4096-b060-7c37fbee941d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:28:37 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:37 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:37 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Driver initialization completed successfully. Nov 03 07:28:37 devstack cinder-volume[86916]: INFO cinder.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Initiating service 3 cleanup Nov 03 07:28:37 devstack cinder-volume[86916]: INFO cinder.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Service 3 cleanup completed. Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.service [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Creating RPC server for service cinder-volume {{(pid=86916) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:28:37 devstack cinder-volume[86916]: DEBUG cinder.service [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86916) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:28:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:38 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:28:38 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:38 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c43b184-91e8-4ff7-b398-538b0e6522ca None None] Driver post RPC initialization completed successfully. Nov 03 07:28:46 devstack cinder-volume[86589]: DEBUG dbcounter [-] [86589] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86589) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:28:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 6 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:28:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Flow 'volume_create_manager' (ee209e42-91cd-4b33-95fc-8479ea66203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e62c8a-2b7e-4bd7-9145-f6c418384703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e62c8a-2b7e-4bd7-9145-f6c418384703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1295589343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555522bb-5f9c-46dc-8649-859c5e574f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6179113775b14e3d9be17e41e1fabac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:38Z,use_quota=True,user_id='96f766025725472f9984cf1283d15cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659423ba-9cfb-459a-95b4-3562af828bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659423ba-9cfb-459a-95b4-3562af828bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffb4f1d-7038-475d-90cc-20edf3f5fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffb4f1d-7038-475d-90cc-20edf3f5fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555522bb-5f9c-46dc-8649-859c5e574f7d', 'volume_name': 'volume-555522bb-5f9c-46dc-8649-859c5e574f7d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd422f6-d9aa-41a7-8258-43b1acbb3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd422f6-d9aa-41a7-8258-43b1acbb3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc8bd1e-a448-4b01-900f-d4eb00eed76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Volume 555522bb-5f9c-46dc-8649-859c5e574f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555522bb-5f9c-46dc-8649-859c5e574f7d', 'volume_size': 1} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1295589343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555522bb-5f9c-46dc-8649-859c5e574f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6179113775b14e3d9be17e41e1fabac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:38Z,use_quota=True,user_id='96f766025725472f9984cf1283d15cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Creating volume 555522bb-5f9c-46dc-8649-859c5e574f7d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:38 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:38 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d 1073741824 Nov 03 07:29:38 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:39 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d 1073741824" returned: 0 in 0.910s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:39 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d Nov 03 07:29:39 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:39 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc8bd1e-a448-4b01-900f-d4eb00eed76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555522bb-5f9c-46dc-8649-859c5e574f7d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea6af8e-c9a6-4fe9-a000-dc9b5c7bc1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Volume volume-555522bb-5f9c-46dc-8649-859c5e574f7d (555522bb-5f9c-46dc-8649-859c5e574f7d): created successfully Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea6af8e-c9a6-4fe9-a000-dc9b5c7bc1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Flow 'volume_create_manager' (ee209e42-91cd-4b33-95fc-8479ea66203b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-809fc8a7-5ce1-40a2-8184-7a240cb0e23c tempest-TaggedAttachmentsTest-2039819466 None] Created volume successfully. Nov 03 07:29:49 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:29:49 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:54 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:29:54 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:54 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.329s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 6 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Flow 'volume_create_manager' (f947b11c-bbee-4d9e-aa53-6f14042dd783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00890c7-ae4a-4c0f-8e7e-6acc3a74caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00890c7-ae4a-4c0f-8e7e-6acc3a74caf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1973432200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1dc70e-9613-4e73-aada-4b9643e530fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e1fe49f77846279e713a18c14b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:21Z,use_quota=True,user_id='b9962a3dc6124ed2b9bd9c53dad4d2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214c2422-5d50-492c-ab53-87af455a0698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214c2422-5d50-492c-ab53-87af455a0698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3504551a-6d1b-4dd5-9edb-b2261f4cf130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3504551a-6d1b-4dd5-9edb-b2261f4cf130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1dc70e-9613-4e73-aada-4b9643e530fd', 'volume_name': 'volume-4c1dc70e-9613-4e73-aada-4b9643e530fd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7132fad2-10f2-44e3-9b46-e2bcf287b8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7132fad2-10f2-44e3-9b46-e2bcf287b8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f509b9-62e3-472a-ac2e-ce95f16e7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Volume 4c1dc70e-9613-4e73-aada-4b9643e530fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1dc70e-9613-4e73-aada-4b9643e530fd', 'volume_size': 1} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1973432200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1dc70e-9613-4e73-aada-4b9643e530fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e1fe49f77846279e713a18c14b5130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:21Z,use_quota=True,user_id='b9962a3dc6124ed2b9bd9c53dad4d2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Creating volume 4c1dc70e-9613-4e73-aada-4b9643e530fd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:21 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd 1073741824 Nov 03 07:30:21 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:23 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd 1073741824" returned: 0 in 1.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:23 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd Nov 03 07:30:23 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:23 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd" returned: 0 in 0.779s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f509b9-62e3-472a-ac2e-ce95f16e7df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1dc70e-9613-4e73-aada-4b9643e530fd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b530a3d-4aaa-4e7f-acd4-077fd9262346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Volume volume-4c1dc70e-9613-4e73-aada-4b9643e530fd (4c1dc70e-9613-4e73-aada-4b9643e530fd): created successfully Nov 03 07:30:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b530a3d-4aaa-4e7f-acd4-077fd9262346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Flow 'volume_create_manager' (f947b11c-bbee-4d9e-aa53-6f14042dd783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f1c4be51-4de3-4952-ae19-6932ae3080cb tempest-VolumesAdminNegativeTest-1927223353 None] Created volume successfully. Nov 03 07:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Acquiring lock "cinder-4c1dc70e-9613-4e73-aada-4b9643e530fd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Lock "cinder-4c1dc70e-9613-4e73-aada-4b9643e530fd-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Acquiring lock "cinder-quobyte-4c1dc70e-9613-4e73-aada-4b9643e530fd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Lock "cinder-quobyte-4c1dc70e-9613-4e73-aada-4b9643e530fd" acquired by "delete_volume" :: waited 0.098s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:27 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpajoasuwp/privsep.sock'] Nov 03 07:30:27 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpajoasuwp/privsep.sock Nov 03 07:30:27 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 07:30:28 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 07:30:29 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:29 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Spawned new privsep daemon via rootwrap Nov 03 07:30:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Accepted privsep connection to /tmp/tmpajoasuwp/privsep.sock {{(pid=86916) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 07:30:29 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 07:30:29 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 07:30:29 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 07:30:29 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88158 Nov 03 07:30:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcdc867-1e02-4676-b8ff-23583b0b1150]: (2,) {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bb9f6f-844d-4ac6-8a30-f7ae4b2c02e6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:29 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd Nov 03 07:30:29 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:30 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd" returned: 0 in 1.185s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:30 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd Nov 03 07:30:30 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:31 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4c1dc70e-9613-4e73-aada-4b9643e530fd" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Lock "cinder-quobyte-4c1dc70e-9613-4e73-aada-4b9643e530fd" released by "delete_volume" :: held 4.606s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:31 devstack cinder-volume[86916]: WARNING cinder.quota [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:30:31 devstack cinder-volume[86916]: WARNING cinder.quota [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:30:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Created reservations ['3ef213f1-a398-4682-a62f-3af8a933097d', '1cf3354d-6edd-4ed5-abb8-5f9d5dd4ffca', '39b124c8-fb6c-4b4e-8452-d8799bc53863', 'e182443e-853c-4ba8-9ea3-c41ae14ff94e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:32 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:30:32 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:32 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.529s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Deleted volume successfully. Nov 03 07:30:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc73392-a1ee-4bf6-b338-b374e03e5958 tempest-VolumesAdminNegativeTest-1927223353 None] Lock "cinder-4c1dc70e-9613-4e73-aada-4b9643e530fd-delete_volume" released by "delete_volume" :: held 6.128s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Flow 'volume_create_manager' (ba675a80-45b1-427d-88d8-2ea3c3c4d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4936a41d-2d2f-4771-ae20-2ec861d74aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4936a41d-2d2f-4771-ae20-2ec861d74aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-405158165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c706a8-4a63-4ecb-a8be-0aaf1a940900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4db24031b874bad9a33a1f53db57ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:38Z,use_quota=True,user_id='0fdfae88f4d448e4b336bef6b5f1f0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d9750b-de37-445a-82af-2727d3541525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d9750b-de37-445a-82af-2727d3541525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb4f283-0983-4e29-bd80-e880b313c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb4f283-0983-4e29-bd80-e880b313c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c706a8-4a63-4ecb-a8be-0aaf1a940900', 'volume_name': 'volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51eb9342-09f9-41c2-9c73-854750546713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51eb9342-09f9-41c2-9c73-854750546713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e95b86-e348-4d5b-8452-fda3cd9d6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Volume b3c706a8-4a63-4ecb-a8be-0aaf1a940900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900', 'volume_size': 1} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-405158165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c706a8-4a63-4ecb-a8be-0aaf1a940900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4db24031b874bad9a33a1f53db57ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:38Z,use_quota=True,user_id='0fdfae88f4d448e4b336bef6b5f1f0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Creating volume b3c706a8-4a63-4ecb-a8be-0aaf1a940900 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:38 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:38 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 1073741824 Nov 03 07:30:38 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:38 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 1073741824" returned: 0 in 0.635s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:39 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 Nov 03 07:30:39 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:39 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900" returned: 0 in 0.308s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e95b86-e348-4d5b-8452-fda3cd9d6479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea073ab-31d0-4636-8f19-6d9c59a77a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Volume volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 (b3c706a8-4a63-4ecb-a8be-0aaf1a940900): created successfully Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea073ab-31d0-4636-8f19-6d9c59a77a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Flow 'volume_create_manager' (ba675a80-45b1-427d-88d8-2ea3c3c4d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-db34cec8-ee8a-4c5f-aa9d-3ede04d68e09 tempest-ServersNegativeTestJSON-1436883321 None] Created volume successfully. Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Flow 'volume_create_manager' (b9cb8090-2f32-40ec-baf0-f409e7996c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d184915a-7176-4e5d-9130-6b42e03c066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d184915a-7176-4e5d-9130-6b42e03c066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2005045931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554bc497-be32-4709-a523-23bc6419275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4db24031b874bad9a33a1f53db57ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:48Z,use_quota=True,user_id='0fdfae88f4d448e4b336bef6b5f1f0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd187a8b-b309-4eab-b646-52abe94783c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd187a8b-b309-4eab-b646-52abe94783c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbe3005-4572-444b-a26d-b25501890b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbe3005-4572-444b-a26d-b25501890b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554bc497-be32-4709-a523-23bc6419275e', 'volume_name': 'volume-554bc497-be32-4709-a523-23bc6419275e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc47081-227f-48e5-830f-fcb2282a6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc47081-227f-48e5-830f-fcb2282a6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560e1e02-71f2-4b91-b926-e1762c3dc7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Volume 554bc497-be32-4709-a523-23bc6419275e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554bc497-be32-4709-a523-23bc6419275e', 'volume_size': 1} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2005045931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554bc497-be32-4709-a523-23bc6419275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4db24031b874bad9a33a1f53db57ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:48Z,use_quota=True,user_id='0fdfae88f4d448e4b336bef6b5f1f0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Creating volume 554bc497-be32-4709-a523-23bc6419275e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:47 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:47 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e 1073741824 Nov 03 07:30:47 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:48 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e 1073741824" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:48 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e Nov 03 07:30:48 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:48 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560e1e02-71f2-4b91-b926-e1762c3dc7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554bc497-be32-4709-a523-23bc6419275e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6063eb-c7ca-4d15-97f7-0616d14c27bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Volume volume-554bc497-be32-4709-a523-23bc6419275e (554bc497-be32-4709-a523-23bc6419275e): created successfully Nov 03 07:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6063eb-c7ca-4d15-97f7-0616d14c27bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Flow 'volume_create_manager' (b9cb8090-2f32-40ec-baf0-f409e7996c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d71101ba-4fa0-4de2-a2c8-a44d618f0ddc tempest-ServersNegativeTestJSON-1436883321 None] Created volume successfully. Nov 03 07:30:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "cinder-554bc497-be32-4709-a523-23bc6419275e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-554bc497-be32-4709-a523-23bc6419275e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "cinder-quobyte-554bc497-be32-4709-a523-23bc6419275e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-quobyte-554bc497-be32-4709-a523-23bc6419275e" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32f8b2a-e084-4824-b43a-14743e85e2e8]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:51 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e Nov 03 07:30:51 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:52 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e" returned: 0 in 0.603s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:52 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e Nov 03 07:30:52 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:52 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-554bc497-be32-4709-a523-23bc6419275e" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-quobyte-554bc497-be32-4709-a523-23bc6419275e" released by "delete_volume" :: held 0.945s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Created reservations ['202580bb-e77d-4db7-a1a6-7133f0cabd0d', '10ce1baf-ba3e-4c07-a5d1-faec0c3b85ed', '0c1cb3d6-0bcc-48c1-a840-1df0a86d0465', 'f9866259-6ae5-45c0-bbc1-ee2a4fcbadc3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:52 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:30:52 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:52 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Deleted volume successfully. Nov 03 07:30:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f7752238-78a1-44dd-aafd-a0d635ce4a3c tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-554bc497-be32-4709-a523-23bc6419275e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "cinder-b3c706a8-4a63-4ecb-a8be-0aaf1a940900-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-b3c706a8-4a63-4ecb-a8be-0aaf1a940900-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "cinder-quobyte-b3c706a8-4a63-4ecb-a8be-0aaf1a940900" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-quobyte-b3c706a8-4a63-4ecb-a8be-0aaf1a940900" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f80b2e-a44c-4a00-9777-e892516d4d5e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:53 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 Nov 03 07:30:53 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:54 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900" returned: 0 in 0.491s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:54 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900 Nov 03 07:30:54 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:54 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:30:54 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:54 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:54 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3c706a8-4a63-4ecb-a8be-0aaf1a940900" returned: 0 in 0.564s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-quobyte-b3c706a8-4a63-4ecb-a8be-0aaf1a940900" released by "delete_volume" :: held 1.137s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Created reservations ['b2c063af-67ad-442d-b002-b320e26e7f9a', 'e305b6b9-f74e-4fd8-9464-7f17ba63243a', 'b076ea66-7ba5-4ce7-915d-340922c0b39a', '39e98bf9-3d29-47f4-a22d-a4c55662e108'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:55 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:30:55 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:55 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Deleted volume successfully. Nov 03 07:30:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-798493f1-986b-4117-a429-381c9b52b723 tempest-ServersNegativeTestJSON-1436883321 None] Lock "cinder-b3c706a8-4a63-4ecb-a8be-0aaf1a940900-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Flow 'volume_create_manager' (2df6ef41-2a26-4e89-a167-00405c1af8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee971c6a-ade2-4488-b6cd-c0a9720f26a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee971c6a-ade2-4488-b6cd-c0a9720f26a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1148996606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb218934-7ee2-499e-8842-2f9a40b76e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd872458ea4344f98577cdb40ebc9d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:05Z,use_quota=True,user_id='f8a1468db004494aa1e8234f51056bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a858142-a5f5-42fa-bfcb-118f52b576dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a858142-a5f5-42fa-bfcb-118f52b576dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa02fd24-365b-4219-92ae-f1dda4373e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa02fd24-365b-4219-92ae-f1dda4373e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb218934-7ee2-499e-8842-2f9a40b76e6b', 'volume_name': 'volume-bb218934-7ee2-499e-8842-2f9a40b76e6b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a2abf4-cf7f-47ac-8ba4-27bbc7fda234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a2abf4-cf7f-47ac-8ba4-27bbc7fda234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf4c821-5d44-4c2f-ad3d-af490cbbb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Volume bb218934-7ee2-499e-8842-2f9a40b76e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb218934-7ee2-499e-8842-2f9a40b76e6b', 'volume_size': 1} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1148996606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb218934-7ee2-499e-8842-2f9a40b76e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd872458ea4344f98577cdb40ebc9d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:05Z,use_quota=True,user_id='f8a1468db004494aa1e8234f51056bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Creating volume bb218934-7ee2-499e-8842-2f9a40b76e6b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:05 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b 1073741824 Nov 03 07:31:05 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:05 devstack cinder-volume[86916]: WARNING py.warnings [req-e9dc8410-1e39-42ee-bab3-11106cfe23d0 req-16331aaa-3ca8-4db9-8e0c-e349bd001f73 tempest-TaggedAttachmentsTest-2039819466 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 07:31:05 devstack cinder-volume[86916]: .first() Nov 03 07:31:05 devstack cinder-volume[86916]: Nov 03 07:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e9dc8410-1e39-42ee-bab3-11106cfe23d0 req-16331aaa-3ca8-4db9-8e0c-e349bd001f73 tempest-TaggedAttachmentsTest-2039819466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:06 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b 1073741824" returned: 0 in 0.887s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:06 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b Nov 03 07:31:06 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:07 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b" returned: 0 in 0.766s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e9dc8410-1e39-42ee-bab3-11106cfe23d0 req-16331aaa-3ca8-4db9-8e0c-e349bd001f73 tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.557s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf4c821-5d44-4c2f-ad3d-af490cbbb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb218934-7ee2-499e-8842-2f9a40b76e6b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5be6fe5-865b-49cb-bb29-e36221e5496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Volume volume-bb218934-7ee2-499e-8842-2f9a40b76e6b (bb218934-7ee2-499e-8842-2f9a40b76e6b): created successfully Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5be6fe5-865b-49cb-bb29-e36221e5496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Flow 'volume_create_manager' (2df6ef41-2a26-4e89-a167-00405c1af8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e9dc8410-1e39-42ee-bab3-11106cfe23d0 req-16331aaa-3ca8-4db9-8e0c-e349bd001f73 tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.360s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c649b7ae-9f45-4f56-bccf-e12a44385e6a tempest-DeleteServersTestJSON-311292293 None] Created volume successfully. Nov 03 07:31:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e9dc8410-1e39-42ee-bab3-11106cfe23d0 req-16331aaa-3ca8-4db9-8e0c-e349bd001f73 tempest-TaggedAttachmentsTest-2039819466 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-555522bb-5f9c-46dc-8649-859c5e574f7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90e5f7ce-67c7-4ea3-a756-2148ec6578d7', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:31:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e9dc8410-1e39-42ee-bab3-11106cfe23d0 req-16331aaa-3ca8-4db9-8e0c-e349bd001f73 tempest-TaggedAttachmentsTest-2039819466 None] attachment_update completed successfully. Nov 03 07:31:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a4b9dcaf-0583-4245-b504-ab590bee8c0d req-738cee59-7196-44df-89d1-101f9aad37d8 tempest-DeleteServersTestJSON-311292293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a4b9dcaf-0583-4245-b504-ab590bee8c0d req-738cee59-7196-44df-89d1-101f9aad37d8 tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a4b9dcaf-0583-4245-b504-ab590bee8c0d req-738cee59-7196-44df-89d1-101f9aad37d8 tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a4b9dcaf-0583-4245-b504-ab590bee8c0d req-738cee59-7196-44df-89d1-101f9aad37d8 tempest-DeleteServersTestJSON-311292293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-bb218934-7ee2-499e-8842-2f9a40b76e6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ca1c95a-f4fe-43b5-aaf1-f037ffef9873', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:31:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-a4b9dcaf-0583-4245-b504-ab590bee8c0d req-738cee59-7196-44df-89d1-101f9aad37d8 tempest-DeleteServersTestJSON-311292293 None] attachment_update completed successfully. Nov 03 07:31:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-1d992ea3-49b9-4f4c-8715-d5358ce39655 req-bf776e19-b610-45ba-b47e-9705331a6025 tempest-TaggedAttachmentsTest-2039819466 None] Terminate volume connection completed successfully. Nov 03 07:31:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-1d992ea3-49b9-4f4c-8715-d5358ce39655 req-bf776e19-b610-45ba-b47e-9705331a6025 tempest-TaggedAttachmentsTest-2039819466 None] Deleting attachment 90e5f7ce-67c7-4ea3-a756-2148ec6578d7. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:31:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-ab4b46d9-58e3-45b3-b01e-317f9589b87f req-4b9dc074-f71d-4825-a99c-c9f7f5c35f6f tempest-DeleteServersTestJSON-311292293 None] Terminate volume connection completed successfully. Nov 03 07:31:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ab4b46d9-58e3-45b3-b01e-317f9589b87f req-4b9dc074-f71d-4825-a99c-c9f7f5c35f6f tempest-DeleteServersTestJSON-311292293 None] Deleting attachment 6ca1c95a-f4fe-43b5-aaf1-f037ffef9873. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Flow 'volume_create_manager' (938c9b60-1022-4388-93fb-6fc1bfd1e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f39f32c-2cf8-42b0-913f-a4fc8fc960a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f39f32c-2cf8-42b0-913f-a4fc8fc960a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-384188269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e7f471-3f7c-4403-9389-86f7211a72f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20a661447a542e79fa51e37e97ff2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:17Z,use_quota=True,user_id='c4354190973d4081b4416128916c8c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355ab31a-5631-42db-aeac-98f20169a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355ab31a-5631-42db-aeac-98f20169a35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c53b02-5bb9-4993-9ae4-7f8463165f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c53b02-5bb9-4993-9ae4-7f8463165f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e7f471-3f7c-4403-9389-86f7211a72f9', 'volume_name': 'volume-f0e7f471-3f7c-4403-9389-86f7211a72f9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e120c1-7947-4e57-8350-3d3b609775dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e120c1-7947-4e57-8350-3d3b609775dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753ca5a9-5f53-4416-9ca6-9e21204032a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Volume f0e7f471-3f7c-4403-9389-86f7211a72f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e7f471-3f7c-4403-9389-86f7211a72f9', 'volume_size': 1} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-384188269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e7f471-3f7c-4403-9389-86f7211a72f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20a661447a542e79fa51e37e97ff2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:17Z,use_quota=True,user_id='c4354190973d4081b4416128916c8c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Creating volume f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:17 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 1073741824 Nov 03 07:31:17 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:18 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 1073741824" returned: 0 in 0.775s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:18 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 Nov 03 07:31:18 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:18 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753ca5a9-5f53-4416-9ca6-9e21204032a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e7f471-3f7c-4403-9389-86f7211a72f9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81829642-c0e2-4b71-9eba-d1828191939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Volume volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 (f0e7f471-3f7c-4403-9389-86f7211a72f9): created successfully Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81829642-c0e2-4b71-9eba-d1828191939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Flow 'volume_create_manager' (938c9b60-1022-4388-93fb-6fc1bfd1e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-cba96832-62be-4b33-a74e-1ae0da7ebb40 req-8b94caef-f38e-4459-a87b-3c10daa8dbb2 tempest-VolumesSnapshotsTestJSON-189333737 None] Created volume successfully. Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Acquiring lock "cinder-bb218934-7ee2-499e-8842-2f9a40b76e6b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Lock "cinder-bb218934-7ee2-499e-8842-2f9a40b76e6b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Acquiring lock "cinder-quobyte-bb218934-7ee2-499e-8842-2f9a40b76e6b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Lock "cinder-quobyte-bb218934-7ee2-499e-8842-2f9a40b76e6b" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf281d6c-dfb6-4d67-b574-80b13bb9621e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:19 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b Nov 03 07:31:19 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=36,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Creating offline snapshot 7a237925-0986-4801-b13b-4ab25d45726b of volume f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fced8d-2093-4d4a-9103-2e87be368d84]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:20 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:20 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b Nov 03 07:31:20 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:20 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 Nov 03 07:31:20 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:20 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bb218934-7ee2-499e-8842-2f9a40b76e6b" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:20 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Lock "cinder-quobyte-bb218934-7ee2-499e-8842-2f9a40b76e6b" released by "delete_volume" :: held 1.157s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:20 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b 1G Nov 03 07:31:20 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Created reservations ['e17057f0-8384-468d-95d7-60be491b103f', '0c15b73f-0da1-4836-b252-4ca29579b35e', '9e831cd9-a056-41b1-b182-46ff1a7a5424', '881787d8-0715-48e1-bb00-1a681131c31a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:20 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:31:20 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:21 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b 1G" returned: 0 in 0.804s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:21 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.573s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Deleted volume successfully. Nov 03 07:31:21 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b Nov 03 07:31:21 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f61dac89-66e9-440f-bd1a-fcfe61a7384e tempest-DeleteServersTestJSON-311292293 None] Lock "cinder-bb218934-7ee2-499e-8842-2f9a40b76e6b-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:21 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:21 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b is being set with open permissions: ugo+rw Nov 03 07:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:21 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b Nov 03 07:31:21 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:22 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:22 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info Nov 03 07:31:22 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:22 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info is being set with open permissions: ugo+rw Nov 03 07:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:22 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info Nov 03 07:31:22 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:22 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.info" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-0288d1ca-97dc-49a5-8c07-03f1dad969bb req-3cf8f3e2-b7eb-4e80-9318-09bfd951f07f tempest-VolumesSnapshotsTestJSON-189333737 None] Create snapshot completed successfully Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "cinder-7a237925-0986-4801-b13b-4ab25d45726b-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-7a237925-0986-4801-b13b-4ab25d45726b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "cinder-quobyte-f0e7f471-3f7c-4403-9389-86f7211a72f9" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-quobyte-f0e7f471-3f7c-4403-9389-86f7211a72f9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "cinder-quobyte-7a237925-0986-4801-b13b-4ab25d45726b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-quobyte-7a237925-0986-4801-b13b-4ab25d45726b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Deleting offline snapshot 7a237925-0986-4801-b13b-4ab25d45726b of volume f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] snapshot_file for this snap is: volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c38ce-fab8-44d8-bcb8-07e1620158a4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:24 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b Nov 03 07:31:24 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:24 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e7f471-3f7c-4403-9389-86f7211a72f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027cc8d-82aa-402e-b521-9bcf090fd482]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:24 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 Nov 03 07:31:24 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:25 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:25 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b Nov 03 07:31:25 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:25 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:25 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b Nov 03 07:31:25 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:25 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9.7a237925-0986-4801-b13b-4ab25d45726b" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-quobyte-7a237925-0986-4801-b13b-4ab25d45726b" released by "_delete_snapshot" :: held 2.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-quobyte-f0e7f471-3f7c-4403-9389-86f7211a72f9" released by "delete_snapshot" :: held 2.180s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack cinder-volume[86916]: WARNING cinder.quota [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:31:26 devstack cinder-volume[86916]: DEBUG cinder.quota [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Created reservations ['cf6870e5-9024-4f1f-a684-611c8b61a315', '4e419df9-6e0b-45d4-b1b3-09c77d4ef067', '4bcb41be-ffec-4675-8a68-bee8789028d0', '8749cfe3-563f-4347-82f5-98a4943f002a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Delete snapshot completed successfully. Nov 03 07:31:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-bee2b214-85b0-4648-9f2d-245057249909 req-7e608681-a378-443b-a930-f96eefed68fa tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-7a237925-0986-4801-b13b-4ab25d45726b-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "cinder-f0e7f471-3f7c-4403-9389-86f7211a72f9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-f0e7f471-3f7c-4403-9389-86f7211a72f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "cinder-quobyte-f0e7f471-3f7c-4403-9389-86f7211a72f9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-quobyte-f0e7f471-3f7c-4403-9389-86f7211a72f9" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a67999-a279-473b-98a7-289b29989b54]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 Nov 03 07:31:27 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9" returned: 0 in 0.488s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9 Nov 03 07:31:28 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f0e7f471-3f7c-4403-9389-86f7211a72f9" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-quobyte-f0e7f471-3f7c-4403-9389-86f7211a72f9" released by "delete_volume" :: held 0.954s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG cinder.quota [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Created reservations ['c4533221-02ca-4621-b1fc-daf004a7724c', 'ae29c70e-3f5c-40ee-a885-929472e6f09f', 'b6796e43-0b7c-4824-b64e-2c7d3793785c', 'ce0e03b5-d82d-4f0b-9eec-811b24e1ab37'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:31:28 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:29 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.463s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:29 devstack cinder-volume[86916]: DEBUG cinder.manager [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Deleted volume successfully. Nov 03 07:31:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6a71250e-efdd-4986-9475-0a0eac107801 req-81259c28-d126-48af-9e44-10e0b06d0c00 tempest-VolumesSnapshotsTestJSON-189333737 None] Lock "cinder-f0e7f471-3f7c-4403-9389-86f7211a72f9-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Acquiring lock "cinder-555522bb-5f9c-46dc-8649-859c5e574f7d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Lock "cinder-555522bb-5f9c-46dc-8649-859c5e574f7d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Acquiring lock "cinder-quobyte-555522bb-5f9c-46dc-8649-859c5e574f7d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Lock "cinder-quobyte-555522bb-5f9c-46dc-8649-859c5e574f7d" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c332483-4cdd-40f5-8a8c-353495586399]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:33 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d Nov 03 07:31:33 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d" returned: 0 in 0.437s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d Nov 03 07:31:34 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-555522bb-5f9c-46dc-8649-859c5e574f7d" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Lock "cinder-quobyte-555522bb-5f9c-46dc-8649-859c5e574f7d" released by "delete_volume" :: held 0.909s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Created reservations ['3a7d66be-4078-4938-8bb0-5ed840122476', 'c5dd7f0d-5e80-4f92-899a-daf478d9dd67', '8934f93d-c272-449b-bd9e-cbd501fb8d26', 'e537d75c-43a4-4ef2-abf8-2b242881fee0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:35 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:31:35 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:35 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Deleted volume successfully. Nov 03 07:31:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407ad164-0141-4b86-87b1-59b19e72888f tempest-TaggedAttachmentsTest-2039819466 None] Lock "cinder-555522bb-5f9c-46dc-8649-859c5e574f7d-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-77a79b41-ab05-4ac4-88f6-7a637a7193d7 tempest-GroupsV314Test-327615929 None] Group tempest-GroupsV314Test-Group-2014770125: creating Nov 03 07:31:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-77a79b41-ab05-4ac4-88f6-7a637a7193d7 tempest-GroupsV314Test-327615929 None] Group tempest-GroupsV314Test-Group-2014770125: created successfully Nov 03 07:31:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-77a79b41-ab05-4ac4-88f6-7a637a7193d7 tempest-GroupsV314Test-327615929 None] Create group completed successfully. Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Flow 'volume_create_manager' (5da7ed0f-58ec-41f4-bd9c-845d0922d8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e91685a-5693-42c9-83c0-78196c5723cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e91685a-5693-42c9-83c0-78196c5723cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1648197678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54eba924-a00f-4317-b04b-aa03dacb709e,host='devstack@QuobyteHD#QuobyteHD',id=22e65d5f-9203-4b78-8ab5-3669e008cc7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d8ffa00ced4913a096dfa65aecf15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:46Z,use_quota=True,user_id='83861baf566b422c9b7da6140a9e131d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b16027c-9ca3-4a75-8099-2b5cd161b581),volume_type_id=7b16027c-9ca3-4a75-8099-2b5cd161b581)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef226301-9caf-4f92-8346-353a6a4efaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef226301-9caf-4f92-8346-353a6a4efaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164b7330-dc45-4cce-9305-b721ca68b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164b7330-dc45-4cce-9305-b721ca68b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e65d5f-9203-4b78-8ab5-3669e008cc7f', 'volume_name': 'volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be8e388-5944-4903-8f99-b89ca2ea4c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be8e388-5944-4903-8f99-b89ca2ea4c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429dd5ba-b3ec-40d6-8c13-1bdaef436736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Volume 22e65d5f-9203-4b78-8ab5-3669e008cc7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f', 'volume_size': 1} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54eba924-a00f-4317-b04b-aa03dacb709e,created_at=2026-11-03T06:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1648197678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54eba924-a00f-4317-b04b-aa03dacb709e,host='devstack@QuobyteHD#QuobyteHD',id=22e65d5f-9203-4b78-8ab5-3669e008cc7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d8ffa00ced4913a096dfa65aecf15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:46Z,use_quota=True,user_id='83861baf566b422c9b7da6140a9e131d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b16027c-9ca3-4a75-8099-2b5cd161b581),volume_type_id=7b16027c-9ca3-4a75-8099-2b5cd161b581)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Creating volume 22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:46 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f 1073741824 Nov 03 07:31:46 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:47 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f 1073741824" returned: 0 in 0.603s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:47 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f Nov 03 07:31:47 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:47 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429dd5ba-b3ec-40d6-8c13-1bdaef436736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0223ad53-c253-4ab2-ad1c-8d9ba25b895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Volume volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f (22e65d5f-9203-4b78-8ab5-3669e008cc7f): created successfully Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0223ad53-c253-4ab2-ad1c-8d9ba25b895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Flow 'volume_create_manager' (5da7ed0f-58ec-41f4-bd9c-845d0922d8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-17628e37-585d-4e7c-8be4-e33afedf5075 tempest-GroupsV314Test-327615929 None] Created volume successfully. Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Cloning volume 22e65d5f-9203-4b78-8ab5-3669e008cc7f to volume 1df92999-eb57-4c75-9168-ce7cf3738b8a Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Creating offline snapshot d1e6f3f9-f950-4073-997e-1938583c6b08 of volume 22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[195abd1e-9cf2-4495-a474-1f1151128d90]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:50 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f Nov 03 07:31:50 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:50 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f" returned: 0 in 0.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:50 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 1G Nov 03 07:31:50 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:51 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 1G" returned: 0 in 0.905s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:51 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 Nov 03 07:31:51 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:52 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08" returned: 0 in 0.517s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:31:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:52 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 Nov 03 07:31:52 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:52 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08" returned: 0 in 0.553s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:52 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info Nov 03 07:31:52 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:53 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:53 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:53 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info Nov 03 07:31:53 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:53 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.info" returned: 0 in 0.471s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Acquiring lock "cinder-quobyte-1df92999-eb57-4c75-9168-ce7cf3738b8a" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-1df92999-eb57-4c75-9168-ce7cf3738b8a" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] snapshot: d1e6f3f9-f950-4073-997e-1938583c6b08, volume: 1df92999-eb57-4c75-9168-ce7cf3738b8a, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d4581-85ae-4a8a-a5f9-2a6c6cee864a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:54 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 Nov 03 07:31:54 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:54 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:31:54 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08" returned: 0 in 0.842s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea4a46-6737-4f38-a917-59ddde3ff95b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:54 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f Nov 03 07:31:54 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.600s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:31:55 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f" returned: 0 in 0.528s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:55 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a Nov 03 07:31:55 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=63,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:02 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:04 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a" returned: 0 in 8.955s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f, size 1024.00 MB, duration 8.96 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:32:04 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Converted 1024.00 MB image at 114.34 MB/s Nov 03 07:32:04 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:04 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a Nov 03 07:32:04 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:04 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a" returned: 0 in 0.446s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-1df92999-eb57-4c75-9168-ce7cf3738b8a" released by "_copy_volume_from_snapshot" :: held 10.933s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Acquiring lock "cinder-quobyte-d1e6f3f9-f950-4073-997e-1938583c6b08" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-d1e6f3f9-f950-4073-997e-1938583c6b08" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Deleting offline snapshot d1e6f3f9-f950-4073-997e-1938583c6b08 of volume 22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] snapshot_file for this snap is: volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ba678-70c4-4239-96ba-dfec3ad30fa3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:05 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 Nov 03 07:32:05 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:05 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08" returned: 0 in 0.985s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d8dd0-d591-48e4-9ad4-82b81f64ce21]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:06 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f Nov 03 07:32:06 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:06 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f" returned: 0 in 0.834s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:06 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 Nov 03 07:32:06 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:07 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08" returned: 0 in 1.082s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:07 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08 Nov 03 07:32:07 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:08 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f.d1e6f3f9-f950-4073-997e-1938583c6b08" returned: 0 in 1.002s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-d1e6f3f9-f950-4073-997e-1938583c6b08" released by "_delete_snapshot" :: held 4.227s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.043s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ebee6dbf-4f4a-42da-bf68-e55fc486e02a tempest-GroupsV314Test-327615929 None] Create group from source-group-54eba924-a00f-4317-b04b-aa03dacb709e completed successfully. Nov 03 07:32:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Acquiring lock "cinder-quobyte-1df92999-eb57-4c75-9168-ce7cf3738b8a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-1df92999-eb57-4c75-9168-ce7cf3738b8a" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e1f7fb-ff44-4e02-89f3-5bc640cad5a5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:12 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a Nov 03 07:32:12 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:12 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a" returned: 0 in 0.716s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:12 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a Nov 03 07:32:12 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:13 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1df92999-eb57-4c75-9168-ce7cf3738b8a" returned: 0 in 0.592s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-1df92999-eb57-4c75-9168-ce7cf3738b8a" released by "delete_volume" :: held 1.407s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Created reservations ['2e384fa2-df4a-499e-b818-d32311173877'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:13 devstack cinder-volume[86916]: WARNING cinder.quota [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1143061231 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1143061231, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:32:13 devstack cinder-volume[86916]: WARNING cinder.quota [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1143061231 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1143061231, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Created reservations ['27066a76-b861-4ea5-84d5-eb2049d79dfc', 'b0156091-b323-4cea-89c0-7f4cba84c19a', '2304302d-ae2c-412c-9bb5-ef4e599b2de5', 'bcbbc180-9faf-468d-923d-8f95fa70cbf2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:13 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:32:13 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:14 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d72c986d-ec42-4e96-bf3b-5892d0fa419f tempest-GroupsV314Test-327615929 None] Delete group completed successfully. Nov 03 07:32:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Acquiring lock "cinder-quobyte-22e65d5f-9203-4b78-8ab5-3669e008cc7f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-22e65d5f-9203-4b78-8ab5-3669e008cc7f" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51868d93-08f2-42db-88eb-a89d7bc85afa]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:15 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f Nov 03 07:32:15 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:16 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f" returned: 0 in 0.900s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:16 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f Nov 03 07:32:16 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:16 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-22e65d5f-9203-4b78-8ab5-3669e008cc7f" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Lock "cinder-quobyte-22e65d5f-9203-4b78-8ab5-3669e008cc7f" released by "delete_volume" :: held 1.409s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Created reservations ['476db04f-1025-4099-9700-7388a8c917f4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Created reservations ['b9303ccd-4e9e-4f7c-98f1-908f7efad0c7', 'a2c94197-bf7c-4af6-a264-17676353cc63', '4fcf225e-168d-4ff5-81f9-7a32a7a3044a', '56f380e0-0850-4f6c-88eb-ea3de94aee7f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:17 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:32:17 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:17 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8a8cb369-30e5-4c37-8c1e-e51d4d634db6 tempest-GroupsV314Test-327615929 None] Delete group completed successfully. Nov 03 07:32:27 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=28,cinder:SELECT=16,cinder:INSERT=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:27 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=21,cinder:SELECT=20,cinder:INSERT=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Flow 'volume_create_manager' (b308f065-e2f4-4254-afa6-70d39ebb61f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c016df5-1e56-4c98-8d61-f733417542e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c016df5-1e56-4c98-8d61-f733417542e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1355769401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33806929-3a5d-4a49-b84b-9f5c7dd3d96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d3a708e2194e7b989a0fed304d58d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:33Z,use_quota=True,user_id='91b04e716abc41eea1098962ad0924d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aaddec-1194-4a54-9da7-76214f6351ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aaddec-1194-4a54-9da7-76214f6351ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1341ed7-ae5b-4429-8508-47b4fbe0fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1341ed7-ae5b-4429-8508-47b4fbe0fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33806929-3a5d-4a49-b84b-9f5c7dd3d96d', 'volume_name': 'volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381c2e71-bb30-4259-8c8b-8a3a0adc6b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381c2e71-bb30-4259-8c8b-8a3a0adc6b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9078fee-6196-43ab-a8d3-939829dcf88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Volume 33806929-3a5d-4a49-b84b-9f5c7dd3d96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d', 'volume_size': 1} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1355769401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33806929-3a5d-4a49-b84b-9f5c7dd3d96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d3a708e2194e7b989a0fed304d58d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:33Z,use_quota=True,user_id='91b04e716abc41eea1098962ad0924d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Creating volume 33806929-3a5d-4a49-b84b-9f5c7dd3d96d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:32:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:33 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d 1073741824 Nov 03 07:32:33 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:34 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d 1073741824" returned: 0 in 1.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:35 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d Nov 03 07:32:35 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:35 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9078fee-6196-43ab-a8d3-939829dcf88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feac592-db94-4419-953d-67807013c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Volume volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d (33806929-3a5d-4a49-b84b-9f5c7dd3d96d): created successfully Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feac592-db94-4419-953d-67807013c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Flow 'volume_create_manager' (b308f065-e2f4-4254-afa6-70d39ebb61f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1ba72f37-e12c-4077-864f-389ae921a9b3 tempest-AttachVolumeShelveTestJSON-533707631 None] Created volume successfully. Nov 03 07:32:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-16b50d5a-3ffd-4476-b55f-c33f61590fb0 req-cabdf1c0-6851-4989-b430-9b2cb6a4488a tempest-AttachVolumeShelveTestJSON-533707631 None] No connector for attachment 6e1822e4-ec2a-43b4-9a94-37d04f36c04d; skipping storage backend terminate_connection call. {{(pid=86916) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 07:32:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-16b50d5a-3ffd-4476-b55f-c33f61590fb0 req-cabdf1c0-6851-4989-b430-9b2cb6a4488a tempest-AttachVolumeShelveTestJSON-533707631 None] Deleting attachment 6e1822e4-ec2a-43b4-9a94-37d04f36c04d. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Flow 'volume_create_manager' (33092b0c-2275-49a2-b62a-86486d28dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2458540e-72d9-4e12-9d68-a08bd1dca6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2458540e-72d9-4e12-9d68-a08bd1dca6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-323695177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a97f314-269b-4908-a5d7-7ebcd8c89d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870744a75f841ed838d3a9a6700d438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:54Z,use_quota=True,user_id='e672a8b0ef174467b8302bf5fd879a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d533164a-8c3b-44e9-8375-876ae7db4433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d533164a-8c3b-44e9-8375-876ae7db4433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0269ebd2-ed24-4547-b175-ab38da3d7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0269ebd2-ed24-4547-b175-ab38da3d7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a97f314-269b-4908-a5d7-7ebcd8c89d19', 'volume_name': 'volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506f60c4-5acd-4d21-a7c4-2f01063651ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506f60c4-5acd-4d21-a7c4-2f01063651ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c1296-e059-48b9-a531-e360abfe1e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Volume 1a97f314-269b-4908-a5d7-7ebcd8c89d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19', 'volume_size': 1} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-323695177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a97f314-269b-4908-a5d7-7ebcd8c89d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870744a75f841ed838d3a9a6700d438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:54Z,use_quota=True,user_id='e672a8b0ef174467b8302bf5fd879a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Creating volume 1a97f314-269b-4908-a5d7-7ebcd8c89d19 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:53 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 1073741824 Nov 03 07:32:53 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:54 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:32:54 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:54 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 1073741824" returned: 0 in 0.698s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:54 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 Nov 03 07:32:54 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:54 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:54 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c1296-e059-48b9-a531-e360abfe1e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffaa1c5-617a-496c-9c5c-3fff60ec722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Volume volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 (1a97f314-269b-4908-a5d7-7ebcd8c89d19): created successfully Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffaa1c5-617a-496c-9c5c-3fff60ec722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Flow 'volume_create_manager' (33092b0c-2275-49a2-b62a-86486d28dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eeadac34-6955-49ca-ad9f-ce49fad413d4 tempest-AttachVolumeNegativeTest-1912171583 None] Created volume successfully. Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Flow 'volume_create_manager' (fb7d6f94-3fde-4719-a579-240d239a6633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cf0456-e9e6-46ff-8f3c-ad7cbb4b2b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cf0456-e9e6-46ff-8f3c-ad7cbb4b2b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1079040376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448d2f0c-34c0-4a02-9076-cbdee7f96a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9cfe5932ec47fcb2b6ab6b99e74e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:57Z,use_quota=True,user_id='c3aeb81533b64036af0a69714f8385b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801015e7-05e9-4d52-bee2-f3dc7234cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801015e7-05e9-4d52-bee2-f3dc7234cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984a113c-0f78-4067-a36a-3defcd9ec910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984a113c-0f78-4067-a36a-3defcd9ec910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448d2f0c-34c0-4a02-9076-cbdee7f96a54', 'volume_name': 'volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8a2aca-c8d7-477c-b224-cffeb8a2f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8a2aca-c8d7-477c-b224-cffeb8a2f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74019300-6d20-482d-9a92-6ae0e1113fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Volume 448d2f0c-34c0-4a02-9076-cbdee7f96a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54', 'volume_size': 1} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1079040376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448d2f0c-34c0-4a02-9076-cbdee7f96a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9cfe5932ec47fcb2b6ab6b99e74e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:57Z,use_quota=True,user_id='c3aeb81533b64036af0a69714f8385b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Creating volume 448d2f0c-34c0-4a02-9076-cbdee7f96a54 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:56 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cb616fb5-a7bb-41d5-95e9-0b3e9e140ffa req-37b16020-8f8a-4657-852c-8fbebce9445b tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:56 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 1073741824 Nov 03 07:32:56 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:57 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 1073741824" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:57 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 Nov 03 07:32:57 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:57 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cb616fb5-a7bb-41d5-95e9-0b3e9e140ffa req-37b16020-8f8a-4657-852c-8fbebce9445b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.059s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74019300-6d20-482d-9a92-6ae0e1113fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4341335e-50b6-4d4f-97b4-0bf9c2692972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cb616fb5-a7bb-41d5-95e9-0b3e9e140ffa req-37b16020-8f8a-4657-852c-8fbebce9445b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Volume volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 (448d2f0c-34c0-4a02-9076-cbdee7f96a54): created successfully Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4341335e-50b6-4d4f-97b4-0bf9c2692972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Flow 'volume_create_manager' (fb7d6f94-3fde-4719-a579-240d239a6633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cbb04ac6-abfa-476c-8b9e-4f7708a9c03a tempest-VolumeQuotasAdminTestJSON-1699551599 None] Created volume successfully. Nov 03 07:32:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cb616fb5-a7bb-41d5-95e9-0b3e9e140ffa req-37b16020-8f8a-4657-852c-8fbebce9445b tempest-AttachVolumeNegativeTest-1912171583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0c9031a-43a7-4a35-be6c-0b9018061d7a', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:32:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-cb616fb5-a7bb-41d5-95e9-0b3e9e140ffa req-37b16020-8f8a-4657-852c-8fbebce9445b tempest-AttachVolumeNegativeTest-1912171583 None] attachment_update completed successfully. Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "cinder-448d2f0c-34c0-4a02-9076-cbdee7f96a54-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "cinder-448d2f0c-34c0-4a02-9076-cbdee7f96a54-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "cinder-quobyte-448d2f0c-34c0-4a02-9076-cbdee7f96a54" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "cinder-quobyte-448d2f0c-34c0-4a02-9076-cbdee7f96a54" acquired by "delete_volume" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa2a76-35e2-40f2-bd80-a5f92944872c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:59 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 Nov 03 07:32:59 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:59 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:00 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54 Nov 03 07:33:00 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:00 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-448d2f0c-34c0-4a02-9076-cbdee7f96a54" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "cinder-quobyte-448d2f0c-34c0-4a02-9076-cbdee7f96a54" released by "delete_volume" :: held 1.105s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Created reservations ['4084ac85-3694-42f2-b096-71daa8a8f405', '1a17ed15-eceb-482d-a1c1-cb9de25f4ac4', '6b690a77-f96c-49c7-818d-ccfec302c22b', '77251957-fb0e-4ef8-9749-2abb37e327b2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:00 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:33:00 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:00 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Deleted volume successfully. Nov 03 07:33:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59aa9748-d246-4d56-89d8-6ee08b1e4a90 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "cinder-448d2f0c-34c0-4a02-9076-cbdee7f96a54-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Flow 'volume_create_manager' (695767f3-376b-474b-937d-33268545e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c62a59-b565-485e-9414-8ecf2a9262ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c62a59-b565-485e-9414-8ecf2a9262ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-936977175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dea1aaf-0329-4ea9-bd04-be1e1c4f4650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9cfe5932ec47fcb2b6ab6b99e74e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:02Z,use_quota=True,user_id='c3aeb81533b64036af0a69714f8385b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d74632-c48b-4939-83cd-aa57fd6b5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d74632-c48b-4939-83cd-aa57fd6b5328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd6f733-925f-4186-a0c2-8a7ba94ca66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd6f733-925f-4186-a0c2-8a7ba94ca66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dea1aaf-0329-4ea9-bd04-be1e1c4f4650', 'volume_name': 'volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b092e73-cb9f-4184-b9d4-882b325ec18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b092e73-cb9f-4184-b9d4-882b325ec18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be197bc-5822-41e9-9972-fc1f95e77f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Volume 5dea1aaf-0329-4ea9-bd04-be1e1c4f4650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650', 'volume_size': 1} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-936977175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dea1aaf-0329-4ea9-bd04-be1e1c4f4650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9cfe5932ec47fcb2b6ab6b99e74e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:02Z,use_quota=True,user_id='c3aeb81533b64036af0a69714f8385b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Creating volume 5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:02 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:02 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 1073741824 Nov 03 07:33:02 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:03 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 1073741824" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:03 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 Nov 03 07:33:03 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:04 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650" returned: 0 in 0.713s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Flow 'volume_create_manager' (4b51c2e1-eb51-4a55-b44d-a9beb8d91591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf80df55-1367-45c8-9f8a-cfbc5174356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be197bc-5822-41e9-9972-fc1f95e77f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbdaf2b-8a5c-4046-8d71-961e6b820d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf80df55-1367-45c8-9f8a-cfbc5174356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1005053632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ef7eba-7ba8-497e-b2eb-cc3cb0e79285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a99206423884cb88fa7b9d94bc5a4a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:04Z,use_quota=True,user_id='d2b86fe3602d4a88a6251f45a11562ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79eeddda-67a8-4952-bea0-38e811dbf91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79eeddda-67a8-4952-bea0-38e811dbf91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c606e7-2a8d-4369-b365-69ac9b5bc68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c606e7-2a8d-4369-b365-69ac9b5bc68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ef7eba-7ba8-497e-b2eb-cc3cb0e79285', 'volume_name': 'volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537838c0-54a8-44be-ba48-123af60bdc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537838c0-54a8-44be-ba48-123af60bdc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f07df-3c65-411d-aad6-eb4beca5620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Volume 52ef7eba-7ba8-497e-b2eb-cc3cb0e79285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285', 'volume_size': 1} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1005053632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ef7eba-7ba8-497e-b2eb-cc3cb0e79285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a99206423884cb88fa7b9d94bc5a4a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:04Z,use_quota=True,user_id='d2b86fe3602d4a88a6251f45a11562ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Creating volume 52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Volume volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 (5dea1aaf-0329-4ea9-bd04-be1e1c4f4650): created successfully Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbdaf2b-8a5c-4046-8d71-961e6b820d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Flow 'volume_create_manager' (695767f3-376b-474b-937d-33268545e00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:04 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 1073741824 Nov 03 07:33:04 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-216b35ce-c355-450f-8da3-205a13758e01 tempest-VolumeQuotasAdminTestJSON-1699551599 None] Created volume successfully. Nov 03 07:33:05 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 1073741824" returned: 0 in 0.881s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:05 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 Nov 03 07:33:05 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:05 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285" returned: 0 in 0.465s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f07df-3c65-411d-aad6-eb4beca5620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a498b-ab0e-499d-9744-7d559f0c84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Volume volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 (52ef7eba-7ba8-497e-b2eb-cc3cb0e79285): created successfully Nov 03 07:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a498b-ab0e-499d-9744-7d559f0c84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Flow 'volume_create_manager' (4b51c2e1-eb51-4a55-b44d-a9beb8d91591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-db98086b-2e55-4cc0-9f50-2fa95c8a8869 tempest-ServerActionsTestOtherA-472758879 None] Created volume successfully. Nov 03 07:33:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-12c8ce96-8ca2-4991-9363-93ff72038a7a tempest-VolumeQuotasAdminTestJSON-1826729557 None] Transfer volume completed successfully. Nov 03 07:33:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Acquiring lock "cinder-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Lock "cinder-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Acquiring lock "cinder-quobyte-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Lock "cinder-quobyte-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650" acquired by "delete_volume" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[140eb212-3377-4d06-9da6-16a797d5bd4e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:08 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 Nov 03 07:33:08 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:09 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650" returned: 0 in 0.560s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:09 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650 Nov 03 07:33:09 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:09 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Lock "cinder-quobyte-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650" released by "delete_volume" :: held 1.115s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Created reservations ['ad665cad-660e-4e70-81ce-1842d1906df5', 'eb0847c5-4a05-4ba0-aac7-f6b36574052e', '2a576bf9-a1d6-4631-b1c0-60652b7364ef', '6af7796b-e23c-4e0c-8df1-b43947d3e833'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:10 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:33:10 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:10 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.502s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Deleted volume successfully. Nov 03 07:33:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-045dc56c-2b25-404f-990f-61cc7b4171b0 tempest-VolumeQuotasAdminTestJSON-1936170784 None] Lock "cinder-5dea1aaf-0329-4ea9-bd04-be1e1c4f4650-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Flow 'volume_create_manager' (01509934-1ca1-4a9a-93c8-2b77fccd1292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40827d6e-a34d-4142-9352-9bf0dd49ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40827d6e-a34d-4142-9352-9bf0dd49ad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1171991097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6c8474-31ee-45e0-a5d6-fb4c662e424e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d833318f3f47939d110b6ccdf533a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:28Z,use_quota=True,user_id='a590ef9b09994235a779bf64378d2bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20966c73-6d25-49bd-bfc3-0f0db72844b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20966c73-6d25-49bd-bfc3-0f0db72844b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9093cd-da8f-4ea2-b5ac-70c232e6bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9093cd-da8f-4ea2-b5ac-70c232e6bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6c8474-31ee-45e0-a5d6-fb4c662e424e', 'volume_name': 'volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278051d0-26d9-483d-a98c-d4c18b1c1e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278051d0-26d9-483d-a98c-d4c18b1c1e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6f1730-489b-4af4-af2b-03443558a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Volume ee6c8474-31ee-45e0-a5d6-fb4c662e424e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e', 'volume_size': 1} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1171991097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6c8474-31ee-45e0-a5d6-fb4c662e424e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d833318f3f47939d110b6ccdf533a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:28Z,use_quota=True,user_id='a590ef9b09994235a779bf64378d2bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Creating volume ee6c8474-31ee-45e0-a5d6-fb4c662e424e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:28 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e 1073741824 Nov 03 07:33:28 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:29 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e 1073741824" returned: 0 in 0.768s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:29 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e Nov 03 07:33:29 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:29 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e" returned: 0 in 0.481s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6f1730-489b-4af4-af2b-03443558a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448dce7e-a308-4e62-a5a3-f852342c7646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Volume volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e (ee6c8474-31ee-45e0-a5d6-fb4c662e424e): created successfully Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448dce7e-a308-4e62-a5a3-f852342c7646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Flow 'volume_create_manager' (01509934-1ca1-4a9a-93c8-2b77fccd1292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6f028277-cfbf-4aca-8296-a5e85b6c0ddb tempest-VolumesServicesTestJSON-836625860 None] Created volume successfully. Nov 03 07:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Acquiring lock "cinder-ee6c8474-31ee-45e0-a5d6-fb4c662e424e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Lock "cinder-ee6c8474-31ee-45e0-a5d6-fb4c662e424e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Acquiring lock "cinder-quobyte-ee6c8474-31ee-45e0-a5d6-fb4c662e424e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Lock "cinder-quobyte-ee6c8474-31ee-45e0-a5d6-fb4c662e424e" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ba8e92-e804-445a-ad41-d2abb35dae41]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:31 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e Nov 03 07:33:31 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:31 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e" returned: 0 in 0.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:31 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e Nov 03 07:33:31 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:32 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ee6c8474-31ee-45e0-a5d6-fb4c662e424e" returned: 0 in 0.612s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Lock "cinder-quobyte-ee6c8474-31ee-45e0-a5d6-fb4c662e424e" released by "delete_volume" :: held 1.411s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Created reservations ['ea4ed158-d652-4a47-8fb7-37d1d3f49667', '30806587-a953-458a-acc7-9420193dff20', '454e40bf-e9b2-4a56-be72-32cff1f2a1a3', '0ed26e98-2415-40d5-93db-947372443563'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:32 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:33:32 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:33 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Deleted volume successfully. Nov 03 07:33:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ab71e99-dacb-496c-9237-5b89a34fb243 tempest-VolumesServicesTestJSON-836625860 None] Lock "cinder-ee6c8474-31ee-45e0-a5d6-fb4c662e424e-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Acquiring lock "cinder-33806929-3a5d-4a49-b84b-9f5c7dd3d96d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "cinder-33806929-3a5d-4a49-b84b-9f5c7dd3d96d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Acquiring lock "cinder-quobyte-33806929-3a5d-4a49-b84b-9f5c7dd3d96d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "cinder-quobyte-33806929-3a5d-4a49-b84b-9f5c7dd3d96d" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2757c7-4eb5-4c79-8095-4512529f4059]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:36 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d Nov 03 07:33:36 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:37 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:37 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d Nov 03 07:33:37 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:37 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-33806929-3a5d-4a49-b84b-9f5c7dd3d96d" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "cinder-quobyte-33806929-3a5d-4a49-b84b-9f5c7dd3d96d" released by "delete_volume" :: held 0.975s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Created reservations ['a0830b2a-d874-408e-afa7-d679b8eb2af5', '09ba1416-3d2d-43ae-8959-bcd6540d333d', '6aa79b11-ea9d-43a0-9a4f-8ead7217d257', '06d409c5-6874-40b9-b03c-b699bf4c71f5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:37 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:33:37 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:37 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Deleted volume successfully. Nov 03 07:33:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-959020ea-e056-4b87-8957-5ca84f1eca69 tempest-AttachVolumeShelveTestJSON-533707631 None] Lock "cinder-33806929-3a5d-4a49-b84b-9f5c7dd3d96d-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=9,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=15,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7e904880-06ad-403d-b089-f08ad026c411 req-67084197-48db-41d6-a0dd-dd2f21bb82fe tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7e904880-06ad-403d-b089-f08ad026c411 req-67084197-48db-41d6-a0dd-dd2f21bb82fe tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7e904880-06ad-403d-b089-f08ad026c411 req-67084197-48db-41d6-a0dd-dd2f21bb82fe tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-7e904880-06ad-403d-b089-f08ad026c411 req-67084197-48db-41d6-a0dd-dd2f21bb82fe tempest-ServerActionsTestOtherA-472758879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b33b051-150a-4556-b803-cd955f31a121', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:33:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-7e904880-06ad-403d-b089-f08ad026c411 req-67084197-48db-41d6-a0dd-dd2f21bb82fe tempest-ServerActionsTestOtherA-472758879 None] attachment_update completed successfully. Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:54 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:33:54 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:55 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.704s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:55 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:33:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:33:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:33:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2421181b-7075-4fc7-b378-f49f860b5fb2 req-909e25a3-39e4-4627-ac34-8e368058504c tempest-AttachVolumeNegativeTest-1912171583 None] Terminate volume connection completed successfully. Nov 03 07:33:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-2421181b-7075-4fc7-b378-f49f860b5fb2 req-909e25a3-39e4-4627-ac34-8e368058504c tempest-AttachVolumeNegativeTest-1912171583 None] Deleting attachment c0c9031a-43a7-4a35-be6c-0b9018061d7a. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:33:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-2095fb3e-4b87-45af-a6e5-fd92d76ab56e tempest-ServerActionsTestOtherA-472758879 None] Terminate volume connection completed successfully. Nov 03 07:33:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-2095fb3e-4b87-45af-a6e5-fd92d76ab56e tempest-ServerActionsTestOtherA-472758879 None] Deleting attachment 6b33b051-150a-4556-b803-cd955f31a121. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:33:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-ab526d1d-16ec-497a-b90b-2dd9b4232662 tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-ab526d1d-16ec-497a-b90b-2dd9b4232662 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-ab526d1d-16ec-497a-b90b-2dd9b4232662 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-ab526d1d-16ec-497a-b90b-2dd9b4232662 tempest-ServerActionsTestOtherA-472758879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfe5db5b-aad5-46c8-81cb-f4f086140b7d', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:33:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6ef72360-e267-4b08-b1ca-2580420eb7ef req-ab526d1d-16ec-497a-b90b-2dd9b4232662 tempest-ServerActionsTestOtherA-472758879 None] attachment_update completed successfully. Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Flow 'volume_create_manager' (c3b58011-c034-45d9-890a-ff4f6cc4b785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34da6cc7-463d-46b4-a200-2abb762908d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34da6cc7-463d-46b4-a200-2abb762908d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-273394606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fb49bc-1d9b-4349-82ab-250831b88c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a362417a560c4cceb717de693cc02f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:09Z,use_quota=True,user_id='9897c689adc84284b6a94fa5075c221d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9e66fd-0935-4321-be66-b8dee50e6794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9e66fd-0935-4321-be66-b8dee50e6794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd62859b-2dea-48bb-895b-48a66fde8559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd62859b-2dea-48bb-895b-48a66fde8559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9fb49bc-1d9b-4349-82ab-250831b88c82', 'volume_name': 'volume-c9fb49bc-1d9b-4349-82ab-250831b88c82', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adca3ed-6365-4f8c-8856-ad3d0961f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adca3ed-6365-4f8c-8856-ad3d0961f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7babf79-30bb-431a-88c0-163549b6154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Volume c9fb49bc-1d9b-4349-82ab-250831b88c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9fb49bc-1d9b-4349-82ab-250831b88c82', 'volume_size': 1} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-273394606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fb49bc-1d9b-4349-82ab-250831b88c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a362417a560c4cceb717de693cc02f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:09Z,use_quota=True,user_id='9897c689adc84284b6a94fa5075c221d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Creating volume c9fb49bc-1d9b-4349-82ab-250831b88c82 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:08 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 1073741824 Nov 03 07:34:08 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:09 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 1073741824" returned: 0 in 0.752s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:09 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 Nov 03 07:34:09 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:10 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7babf79-30bb-431a-88c0-163549b6154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fb49bc-1d9b-4349-82ab-250831b88c82', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ce593f-1435-4852-ab8f-2d42478c1b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Volume volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 (c9fb49bc-1d9b-4349-82ab-250831b88c82): created successfully Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ce593f-1435-4852-ab8f-2d42478c1b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Flow 'volume_create_manager' (c3b58011-c034-45d9-890a-ff4f6cc4b785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad2451ba-3318-4fa2-8d43-4b98b722ca3c tempest-VolumesListAdminTestJSON-628384731 None] Created volume successfully. Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Flow 'volume_create_manager' (6c2e0f08-6e10-4b18-bc44-7570d629693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7a99cb-cc38-40b8-b372-2d4d58278013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7a99cb-cc38-40b8-b372-2d4d58278013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1772989572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a362417a560c4cceb717de693cc02f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:12Z,use_quota=True,user_id='9897c689adc84284b6a94fa5075c221d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecf8857-609a-4f59-8181-51a8a80f282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecf8857-609a-4f59-8181-51a8a80f282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a171e3-365d-4c6c-9c83-c038a520a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a171e3-365d-4c6c-9c83-c038a520a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d', 'volume_name': 'volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f83fc6-1f3b-4ef6-a171-aa91429ff925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f83fc6-1f3b-4ef6-a171-aa91429ff925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27089351-a3c0-4a1e-a788-3184d276ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Volume 9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d', 'volume_size': 1} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1772989572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a362417a560c4cceb717de693cc02f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:12Z,use_quota=True,user_id='9897c689adc84284b6a94fa5075c221d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Creating volume 9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:12 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d 1073741824 Nov 03 07:34:12 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:12 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d 1073741824" returned: 0 in 0.677s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:12 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d Nov 03 07:34:12 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:13 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d" returned: 0 in 0.443s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27089351-a3c0-4a1e-a788-3184d276ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441e0164-632f-4cb5-8873-3a16ace76437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Volume volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d (9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d): created successfully Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441e0164-632f-4cb5-8873-3a16ace76437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Flow 'volume_create_manager' (6c2e0f08-6e10-4b18-bc44-7570d629693e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a3292250-3be2-40aa-bb64-589fbb1a2983 tempest-VolumesListAdminTestJSON-628384731 None] Created volume successfully. Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Flow 'volume_create_manager' (05afb160-811f-4298-8c97-abfe082259bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e9cf04-0386-4032-9a82-b5ba9252bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e9cf04-0386-4032-9a82-b5ba9252bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1948307569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a362417a560c4cceb717de693cc02f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:15Z,use_quota=True,user_id='9897c689adc84284b6a94fa5075c221d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7541b12c-29ae-4287-be8e-a75a520799a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7541b12c-29ae-4287-be8e-a75a520799a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b85b4e8-cac5-448a-8aeb-04c7c9f10f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b85b4e8-cac5-448a-8aeb-04c7c9f10f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46', 'volume_name': 'volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bfd80f-56dd-498e-aeb8-3d854c5ba5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bfd80f-56dd-498e-aeb8-3d854c5ba5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2f3d1a-ebd2-4e5d-b48a-b49b50a9fc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Volume 5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46', 'volume_size': 1} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1948307569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a362417a560c4cceb717de693cc02f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:15Z,use_quota=True,user_id='9897c689adc84284b6a94fa5075c221d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Creating volume 5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:15 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 1073741824 Nov 03 07:34:15 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:16 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 1073741824" returned: 0 in 1.007s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:16 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 Nov 03 07:34:16 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:16 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46" returned: 0 in 0.329s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2f3d1a-ebd2-4e5d-b48a-b49b50a9fc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dd4448-dbda-4fe5-902b-54d35a67f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Volume volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 (5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46): created successfully Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dd4448-dbda-4fe5-902b-54d35a67f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Flow 'volume_create_manager' (05afb160-811f-4298-8c97-abfe082259bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cdfcd99a-b5e1-4e27-9899-1527a8e98756 tempest-VolumesListAdminTestJSON-628384731 None] Created volume successfully. Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Flow 'volume_create_manager' (8181b775-aa11-4933-9e83-307f961e0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a474c57-741d-4640-b841-b3ba398ad1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a474c57-741d-4640-b841-b3ba398ad1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c767d2-3f59-4241-b6ad-6ed7697f73d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c7b68d84cf4c1e9a541ee46a8c9fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:18Z,use_quota=True,user_id='884af47bf8f848dea3854f35ba0799f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b46c98-d1d8-4be7-865b-80c44e407b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b46c98-d1d8-4be7-865b-80c44e407b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78500b8e-ff43-4e44-9b70-18c1de12abd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78500b8e-ff43-4e44-9b70-18c1de12abd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c767d2-3f59-4241-b6ad-6ed7697f73d0', 'volume_name': 'volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf0e90b-d90f-4869-ab6e-990bed6272b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf0e90b-d90f-4869-ab6e-990bed6272b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667d52a5-c91c-437a-8eff-4a485713a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Volume 45c767d2-3f59-4241-b6ad-6ed7697f73d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0', 'volume_size': 1} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c767d2-3f59-4241-b6ad-6ed7697f73d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c7b68d84cf4c1e9a541ee46a8c9fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:18Z,use_quota=True,user_id='884af47bf8f848dea3854f35ba0799f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Creating volume 45c767d2-3f59-4241-b6ad-6ed7697f73d0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:18 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 1073741824 Nov 03 07:34:18 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:19 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 1073741824" returned: 0 in 0.837s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:19 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 Nov 03 07:34:19 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:19 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0" returned: 0 in 0.329s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667d52a5-c91c-437a-8eff-4a485713a87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbafd10-bf3a-4d90-868b-630ab7c24538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Volume volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 (45c767d2-3f59-4241-b6ad-6ed7697f73d0): created successfully Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbafd10-bf3a-4d90-868b-630ab7c24538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Flow 'volume_create_manager' (8181b775-aa11-4933-9e83-307f961e0d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f6a49599-b00b-4901-b041-b718f6488bb8 tempest-VolumesListAdminTestJSON-970553684 None] Created volume successfully. Nov 03 07:34:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Acquiring lock "cinder-45c767d2-3f59-4241-b6ad-6ed7697f73d0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Lock "cinder-45c767d2-3f59-4241-b6ad-6ed7697f73d0-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Acquiring lock "cinder-quobyte-45c767d2-3f59-4241-b6ad-6ed7697f73d0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Lock "cinder-quobyte-45c767d2-3f59-4241-b6ad-6ed7697f73d0" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04df498-58c1-4230-bf6a-5b5ba088db5d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "cinder-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "cinder-quobyte-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-quobyte-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46" acquired by "delete_volume" :: waited 0.064s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ef4370-90df-4088-a82c-a308331b4e46]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:21 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 Nov 03 07:34:21 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:21 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 Nov 03 07:34:21 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:22 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0" returned: 0 in 1.176s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:22 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0 Nov 03 07:34:22 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:22 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46" returned: 0 in 0.962s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:22 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46 Nov 03 07:34:22 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:23 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-45c767d2-3f59-4241-b6ad-6ed7697f73d0" returned: 0 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Lock "cinder-quobyte-45c767d2-3f59-4241-b6ad-6ed7697f73d0" released by "delete_volume" :: held 2.201s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:23 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46" returned: 0 in 0.775s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-quobyte-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46" released by "delete_volume" :: held 1.847s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Created reservations ['12dc5926-986b-49f0-bb4c-e693ad7534ec', '0c70f0a1-68a2-4beb-98bd-058cf7438352', 'c5de94d3-24f3-4a60-bf40-615687c0367d', 'c5fea73f-c6a1-4137-96e0-2da0bcbdd180'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Created reservations ['b602357c-302c-4fd2-81fd-a4d31df41d2b', '68dd8366-425f-4c84-aabe-d02834efecb0', '8d470349-e14f-493e-9ef0-84ccfbe06d5f', 'f45d4d87-a968-418b-bb97-3aa438892a1f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:23 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:34:23 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:23 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:34:23 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "cinder-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:24 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.572s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Deleted volume successfully. Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb5f5321-7661-464b-8a35-0e2323383367 tempest-VolumesListAdminTestJSON-970553684 None] Lock "cinder-45c767d2-3f59-4241-b6ad-6ed7697f73d0-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "cinder-quobyte-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-quobyte-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d" acquired by "delete_volume" :: waited 0.052s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:24 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.739s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Deleted volume successfully. Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[477f94d5-1a4f-435d-92d8-2d0bed22487e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbf31220-2503-423d-bc2c-844dd0efc9e9 tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-5ee4ade4-4d75-4f3f-b76f-fc51f56b2d46-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:24 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d Nov 03 07:34:24 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:25 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d" returned: 0 in 0.655s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:25 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d Nov 03 07:34:25 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:25 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d" returned: 0 in 0.541s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-quobyte-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d" released by "delete_volume" :: held 1.324s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Created reservations ['bb00494e-b445-4361-af8e-af779de60b37', '09ad169e-fe2d-4e71-9a22-69c024f0d510', '71448b00-1ee1-43af-b473-ddb9f35f84a3', '072100e0-e51d-4e27-b820-afeefeb42f12'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:25 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:34:25 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:26 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Deleted volume successfully. Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-71231793-5ecc-4f7d-8d18-a0705183a53d tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-9f9fd531-9a4b-4fb4-bf0f-a2bad0dcc30d-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "cinder-c9fb49bc-1d9b-4349-82ab-250831b88c82-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-c9fb49bc-1d9b-4349-82ab-250831b88c82-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "cinder-quobyte-c9fb49bc-1d9b-4349-82ab-250831b88c82" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-quobyte-c9fb49bc-1d9b-4349-82ab-250831b88c82" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a32a8-befd-429e-adcc-f9cc5cef8d61]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:27 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 Nov 03 07:34:27 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:27 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82" returned: 0 in 0.562s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:27 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82 Nov 03 07:34:27 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:27 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9fb49bc-1d9b-4349-82ab-250831b88c82" returned: 0 in 0.541s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-quobyte-c9fb49bc-1d9b-4349-82ab-250831b88c82" released by "delete_volume" :: held 1.210s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Created reservations ['58c3d5b4-0260-45d2-bb8e-a2b0c7f7326f', '414a2b3b-c2d9-4a82-b043-f8b7a0e8f808', '52445d10-e59a-400f-88dd-c74c90839e39', 'beb674be-1955-4e94-bb55-7a159b3afb9a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:28 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:34:28 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:29 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Deleted volume successfully. Nov 03 07:34:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-11f0d971-f6e9-4c8c-b99b-c34050a0784c tempest-VolumesListAdminTestJSON-628384731 None] Lock "cinder-c9fb49bc-1d9b-4349-82ab-250831b88c82-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-33c3453a-653c-499f-8754-d0b27efd5a9f req-472432dd-1cf4-44d5-9c09-201dbf975797 tempest-ServerActionsTestOtherA-472758879 None] Terminate volume connection completed successfully. Nov 03 07:34:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-33c3453a-653c-499f-8754-d0b27efd5a9f req-472432dd-1cf4-44d5-9c09-201dbf975797 tempest-ServerActionsTestOtherA-472758879 None] Deleting attachment dfe5db5b-aad5-46c8-81cb-f4f086140b7d. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Flow 'volume_create_manager' (2054b234-ffca-4024-a1ed-09b871ca1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dca31e0-8608-4759-b6b6-284d2317572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dca31e0-8608-4759-b6b6-284d2317572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2001051372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6237cf-ff1c-48b6-81f9-fa4618ea5460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a99206423884cb88fa7b9d94bc5a4a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:44Z,use_quota=True,user_id='d2b86fe3602d4a88a6251f45a11562ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82c5f7c-5f8a-4c2e-8058-1f119be368ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82c5f7c-5f8a-4c2e-8058-1f119be368ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2681e2e-2209-4062-90e0-aa889ab8a0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:43 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:34:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2681e2e-2209-4062-90e0-aa889ab8a0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f6237cf-ff1c-48b6-81f9-fa4618ea5460', 'volume_name': 'volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eac64a-d456-4a95-91da-94393f223205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eac64a-d456-4a95-91da-94393f223205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9606953-789f-4b12-bd74-b9c36599a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Volume 2f6237cf-ff1c-48b6-81f9-fa4618ea5460: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:34:44 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Trying to clone 2f6237cf-ff1c-48b6-81f9-fa4618ea5460 from image 4c501e6d-7c58-4118-a8ef-07458ac1339d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:34:45 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:34:45 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:34:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c642fba2-d7e5-43b7-9f01-bea7a55e3d4b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:45 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD Nov 03 07:34:45 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:46 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d is fetched for user d2b86fe3602d4a88a6251f45a11562ec. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dafa0f-20b7-4f59-bb4e-82c58ac75204]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:46 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD Nov 03 07:34:46 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:46 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2001051372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6237cf-ff1c-48b6-81f9-fa4618ea5460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a99206423884cb88fa7b9d94bc5a4a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:44Z,use_quota=True,user_id='d2b86fe3602d4a88a6251f45a11562ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Creating volume 2f6237cf-ff1c-48b6-81f9-fa4618ea5460 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:46 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 1073741824 Nov 03 07:34:46 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:47 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 1073741824" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:47 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 Nov 03 07:34:47 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:47 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Attempting download of 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 2f6237cf-ff1c-48b6-81f9-fa4618ea5460. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[544d8f8d-9151-4f8d-bfba-bab888233580]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk Nov 03 07:34:48 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Flow 'volume_create_manager' (d3ab0707-6944-4042-b9c0-287bb07dd4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:48 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a226ce-8dc4-40d6-8595-dd78362e65eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk" returned: 0 in 0.492s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a226ce-8dc4-40d6-8595-dd78362e65eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2083762235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ee7c6b-6570-4c82-b32a-1fb206b60785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870744a75f841ed838d3a9a6700d438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:48Z,use_quota=True,user_id='e672a8b0ef174467b8302bf5fd879a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c478c9c5-35fd-45ca-bef8-3b16ca226fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c478c9c5-35fd-45ca-bef8-3b16ca226fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99356a5e-1d2e-4851-b617-c02dd1165def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99356a5e-1d2e-4851-b617-c02dd1165def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ee7c6b-6570-4c82-b32a-1fb206b60785', 'volume_name': 'volume-89ee7c6b-6570-4c82-b32a-1fb206b60785', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6695ccac-528a-4e7d-9d7a-98cdfd9b15d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6695ccac-528a-4e7d-9d7a-98cdfd9b15d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844891e4-6fb5-4cc0-9926-06d233242f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Volume 89ee7c6b-6570-4c82-b32a-1fb206b60785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ee7c6b-6570-4c82-b32a-1fb206b60785', 'volume_size': 1} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2083762235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ee7c6b-6570-4c82-b32a-1fb206b60785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870744a75f841ed838d3a9a6700d438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:48Z,use_quota=True,user_id='e672a8b0ef174467b8302bf5fd879a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Creating volume 89ee7c6b-6570-4c82-b32a-1fb206b60785 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk Nov 03 07:34:48 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:48 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 1073741824 Nov 03 07:34:48 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:48 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk" returned: 1 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_0ihyzdpk' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40237dd-b43c-4a7b-8c83-d294f437463a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:48 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD Nov 03 07:34:48 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:49 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 1073741824" returned: 0 in 0.583s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:49 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 Nov 03 07:34:49 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:49 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] 4c501e6d-7c58-4118-a8ef-07458ac1339d was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:49 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 Nov 03 07:34:49 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:49 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785" returned: 0 in 0.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844891e4-6fb5-4cc0-9926-06d233242f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ee7c6b-6570-4c82-b32a-1fb206b60785', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae5b84e-66d7-42b6-8606-8b73a2ec60ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Volume volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 (89ee7c6b-6570-4c82-b32a-1fb206b60785): created successfully Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae5b84e-66d7-42b6-8606-8b73a2ec60ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Flow 'volume_create_manager' (d3ab0707-6944-4042-b9c0-287bb07dd4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-71696319-f1b4-4b72-9bf1-9349cb655930 tempest-AttachVolumeNegativeTest-1912171583 None] Created volume successfully. Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Flow 'volume_create_manager' (3ab9789f-63df-43cc-ae93-f3613286c9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a09de-0d3e-43c9-8182-8e076f9d20e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a09de-0d3e-43c9-8182-8e076f9d20e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2096117994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04415124-6727-482a-ae09-795b7065fd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4282f19eb804f01b4bfbc674d473aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:51Z,use_quota=True,user_id='23381a61d3fa4e1682f942ea1b185417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100c4f4a-9852-4494-ae9f-4dff0c7a8d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100c4f4a-9852-4494-ae9f-4dff0c7a8d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f513e322-d72d-4f5e-8edd-ff57ad1574f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f513e322-d72d-4f5e-8edd-ff57ad1574f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04415124-6727-482a-ae09-795b7065fd79', 'volume_name': 'volume-04415124-6727-482a-ae09-795b7065fd79', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c32d774-fe45-431c-9d60-bcf7ca38aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c32d774-fe45-431c-9d60-bcf7ca38aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9aa00b-16cc-47d9-bd6a-b61ac198a157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Volume 04415124-6727-482a-ae09-795b7065fd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04415124-6727-482a-ae09-795b7065fd79', 'volume_size': 1} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2096117994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04415124-6727-482a-ae09-795b7065fd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4282f19eb804f01b4bfbc674d473aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:51Z,use_quota=True,user_id='23381a61d3fa4e1682f942ea1b185417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Creating volume 04415124-6727-482a-ae09-795b7065fd79 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:50 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 1073741824 Nov 03 07:34:50 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 1073741824" returned: 0 in 0.596s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4ad0b27e-7de2-4e42-82c2-2c9e602ceb46 req-06624113-31e4-48cb-83a0-26bc44ae3c49 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:51 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 Nov 03 07:34:51 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" returned: 0 in 2.586s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_rnk7d18mdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:34:51 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Converted 112.00 MB image at 43.30 MB/s Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:51 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 1G Nov 03 07:34:51 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4ad0b27e-7de2-4e42-82c2-2c9e602ceb46 req-06624113-31e4-48cb-83a0-26bc44ae3c49 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.321s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4ad0b27e-7de2-4e42-82c2-2c9e602ceb46 req-06624113-31e4-48cb-83a0-26bc44ae3c49 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9aa00b-16cc-47d9-bd6a-b61ac198a157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04415124-6727-482a-ae09-795b7065fd79', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1a7613-ccfb-43f0-894b-6ab57ad7bab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Volume volume-04415124-6727-482a-ae09-795b7065fd79 (04415124-6727-482a-ae09-795b7065fd79): created successfully Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1a7613-ccfb-43f0-894b-6ab57ad7bab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Flow 'volume_create_manager' (3ab9789f-63df-43cc-ae93-f3613286c9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3f788ac0-5001-446f-a81a-de0fb50b2d8c tempest-VolumesTransfersV357Test-2901027 None] Created volume successfully. Nov 03 07:34:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-4ad0b27e-7de2-4e42-82c2-2c9e602ceb46 req-06624113-31e4-48cb-83a0-26bc44ae3c49 tempest-AttachVolumeNegativeTest-1912171583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-89ee7c6b-6570-4c82-b32a-1fb206b60785', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abc8a5ed-6cd2-4311-b2b5-a25541b84795', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:34:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-4ad0b27e-7de2-4e42-82c2-2c9e602ceb46 req-06624113-31e4-48cb-83a0-26bc44ae3c49 tempest-AttachVolumeNegativeTest-1912171583 None] attachment_update completed successfully. Nov 03 07:34:52 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 1G" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Downloaded image 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 2f6237cf-ff1c-48b6-81f9-fa4618ea5460 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d for user d2b86fe3602d4a88a6251f45a11562ec is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Marking volume 2f6237cf-ff1c-48b6-81f9-fa4618ea5460 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Copying metadata from image 4c501e6d-7c58-4118-a8ef-07458ac1339d to 2f6237cf-ff1c-48b6-81f9-fa4618ea5460. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Creating volume glance metadata for volume 2f6237cf-ff1c-48b6-81f9-fa4618ea5460 backed by image 4c501e6d-7c58-4118-a8ef-07458ac1339d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9606953-789f-4b12-bd74-b9c36599a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918ae589-4d79-4576-830c-436b03026308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Volume volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 (2f6237cf-ff1c-48b6-81f9-fa4618ea5460): created successfully Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918ae589-4d79-4576-830c-436b03026308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Flow 'volume_create_manager' (2054b234-ffca-4024-a1ed-09b871ca1dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7498de81-dad7-4e31-9924-fcefd8cc3773 tempest-ServerActionsTestOtherA-472758879 None] Created volume successfully. Nov 03 07:34:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6c197d49-5bd3-4175-ab38-7fcee495c1bd tempest-VolumesTransfersV357Test-936596764 None] Transfer volume completed successfully. Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:54 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:34:54 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8cb68098-06bd-4bc6-b743-99286bbfec8e req-9fe5eec9-32f4-4bf0-8e59-99eeb3570125 tempest-AttachVolumeNegativeTest-1912171583 None] Terminate volume connection completed successfully. Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8cb68098-06bd-4bc6-b743-99286bbfec8e req-9fe5eec9-32f4-4bf0-8e59-99eeb3570125 tempest-AttachVolumeNegativeTest-1912171583 None] Deleting attachment abc8a5ed-6cd2-4311-b2b5-a25541b84795. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:34:54 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.438s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Acquiring lock "cinder-04415124-6727-482a-ae09-795b7065fd79-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-04415124-6727-482a-ae09-795b7065fd79-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Acquiring lock "cinder-quobyte-04415124-6727-482a-ae09-795b7065fd79" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-quobyte-04415124-6727-482a-ae09-795b7065fd79" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6617fa-85e2-4747-b47b-1b76d52e2afa]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:55 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 Nov 03 07:34:55 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:55 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79" returned: 0 in 0.525s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:55 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79 Nov 03 07:34:55 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:56 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04415124-6727-482a-ae09-795b7065fd79" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-quobyte-04415124-6727-482a-ae09-795b7065fd79" released by "delete_volume" :: held 1.170s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Created reservations ['36a8c983-0ca3-45a6-8f20-b7aaa71c02cc', '85cf23ca-83a7-43e4-9bda-663cece1a842', 'eb9ca8f7-d2b2-4b1c-959a-d748a08ba804', 'a446b889-b867-42d4-ab9f-5902662d5890'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:56 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:34:56 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:56 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Deleted volume successfully. Nov 03 07:34:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2dd96971-354f-4c0b-95a7-84c4267229d8 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-04415124-6727-482a-ae09-795b7065fd79-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-452b2925-8398-4d53-a846-0e6a958348ca req-88530fc0-1dc7-4a99-9bfa-411b97874b30 tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-452b2925-8398-4d53-a846-0e6a958348ca req-88530fc0-1dc7-4a99-9bfa-411b97874b30 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-452b2925-8398-4d53-a846-0e6a958348ca req-88530fc0-1dc7-4a99-9bfa-411b97874b30 tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-452b2925-8398-4d53-a846-0e6a958348ca req-88530fc0-1dc7-4a99-9bfa-411b97874b30 tempest-ServerActionsTestOtherA-472758879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '878c8ac7-ccef-4717-801d-b02086f1c984', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:34:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-452b2925-8398-4d53-a846-0e6a958348ca req-88530fc0-1dc7-4a99-9bfa-411b97874b30 tempest-ServerActionsTestOtherA-472758879 None] attachment_update completed successfully. Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Flow 'volume_create_manager' (f959de92-64cd-497b-8996-1dfc417f41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b99916-dd2a-40f2-9356-2f3c6c440c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b99916-dd2a-40f2-9356-2f3c6c440c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1878966335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4c4121-5203-4300-8bc0-552005491b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4282f19eb804f01b4bfbc674d473aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:58Z,use_quota=True,user_id='23381a61d3fa4e1682f942ea1b185417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b04084-91c5-48d7-9030-4403df9784ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b04084-91c5-48d7-9030-4403df9784ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb261ff6-3523-47f3-9ff2-8cba78ff9cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb261ff6-3523-47f3-9ff2-8cba78ff9cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4c4121-5203-4300-8bc0-552005491b0d', 'volume_name': 'volume-0e4c4121-5203-4300-8bc0-552005491b0d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ba4fa9-24cc-4120-805f-c4fa69f6074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ba4fa9-24cc-4120-805f-c4fa69f6074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83e5afd-c506-4c87-9e10-ab9cf1f748ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Volume 0e4c4121-5203-4300-8bc0-552005491b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4c4121-5203-4300-8bc0-552005491b0d', 'volume_size': 1} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1878966335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4c4121-5203-4300-8bc0-552005491b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4282f19eb804f01b4bfbc674d473aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:58Z,use_quota=True,user_id='23381a61d3fa4e1682f942ea1b185417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Creating volume 0e4c4121-5203-4300-8bc0-552005491b0d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:34:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:58 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d 1073741824 Nov 03 07:34:58 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Flow 'volume_create_manager' (b857cf0d-3174-4a91-af2f-eb7940f4c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda39066-03c7-4f12-aa04-18f6b0a70967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda39066-03c7-4f12-aa04-18f6b0a70967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1077744156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736de742-b09c-4bb4-a446-da80ee3c3963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce34d9cda6d4bb0a117f7522e7dd67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:59Z,use_quota=True,user_id='bf6ad6fb73c0480db62755f16ba2f2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737dcfb4-1b25-47fd-9f4a-1207247c1b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737dcfb4-1b25-47fd-9f4a-1207247c1b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1895f16-d42c-4610-8b96-ea2ed199cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1895f16-d42c-4610-8b96-ea2ed199cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736de742-b09c-4bb4-a446-da80ee3c3963', 'volume_name': 'volume-736de742-b09c-4bb4-a446-da80ee3c3963', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162c280a-f81f-4391-a174-5d0e46142d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162c280a-f81f-4391-a174-5d0e46142d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe50f750-1bad-43d7-9f4c-2c292bae7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Volume 736de742-b09c-4bb4-a446-da80ee3c3963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736de742-b09c-4bb4-a446-da80ee3c3963', 'volume_size': 1} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:59 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d 1073741824" returned: 0 in 0.878s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:59 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d Nov 03 07:34:59 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:00 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1077744156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736de742-b09c-4bb4-a446-da80ee3c3963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce34d9cda6d4bb0a117f7522e7dd67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:59Z,use_quota=True,user_id='bf6ad6fb73c0480db62755f16ba2f2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Creating volume 736de742-b09c-4bb4-a446-da80ee3c3963 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:00 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83e5afd-c506-4c87-9e10-ab9cf1f748ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4c4121-5203-4300-8bc0-552005491b0d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:00 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 1073741824 Nov 03 07:35:00 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8563bcb4-4027-49aa-8533-46337c915afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Volume volume-0e4c4121-5203-4300-8bc0-552005491b0d (0e4c4121-5203-4300-8bc0-552005491b0d): created successfully Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8563bcb4-4027-49aa-8533-46337c915afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Flow 'volume_create_manager' (f959de92-64cd-497b-8996-1dfc417f41a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-49594a6e-2238-4378-aa49-76f789c91e34 tempest-VolumesTransfersV357Test-2901027 None] Created volume successfully. Nov 03 07:35:00 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 1073741824" returned: 0 in 0.764s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Acquiring lock "cinder-0e4c4121-5203-4300-8bc0-552005491b0d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:01 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 Nov 03 07:35:01 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-0e4c4121-5203-4300-8bc0-552005491b0d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Acquiring lock "cinder-quobyte-0e4c4121-5203-4300-8bc0-552005491b0d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-quobyte-0e4c4121-5203-4300-8bc0-552005491b0d" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f1a512-4d0f-4c2c-9c6a-89141d7f2512]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:01 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d Nov 03 07:35:01 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:01 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963" returned: 0 in 0.544s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe50f750-1bad-43d7-9f4c-2c292bae7de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736de742-b09c-4bb4-a446-da80ee3c3963', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c28fab-6fca-47fa-8063-d6c9241c5e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Volume volume-736de742-b09c-4bb4-a446-da80ee3c3963 (736de742-b09c-4bb4-a446-da80ee3c3963): created successfully Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c28fab-6fca-47fa-8063-d6c9241c5e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Flow 'volume_create_manager' (b857cf0d-3174-4a91-af2f-eb7940f4c789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b8d80f5-6c3e-483a-ae15-8b3f7f1e3ef9 tempest-AttachVolumeTestJSON-1674610177 None] Created volume successfully. Nov 03 07:35:01 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d" returned: 0 in 0.665s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:01 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d Nov 03 07:35:01 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:02 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0e4c4121-5203-4300-8bc0-552005491b0d" returned: 0 in 0.537s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-quobyte-0e4c4121-5203-4300-8bc0-552005491b0d" released by "delete_volume" :: held 1.328s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Created reservations ['b85a7c15-c2eb-48ab-9f14-fc57611bf387', '0a7ab078-4b0a-42f0-a278-7c173029b56b', '65ea9c85-f68b-4691-8551-d08d53a05eb6', '393ddce9-9099-4140-9d66-2b5c16425706'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:02 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:35:02 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:03 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.543s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Deleted volume successfully. Nov 03 07:35:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cd6fe1c-5070-46df-ab90-84d7b21b1aa2 tempest-VolumesTransfersV357Test-366326398 None] Lock "cinder-0e4c4121-5203-4300-8bc0-552005491b0d-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6ba7fd30-0a65-4e17-a39f-1dac4e6cfec9 req-092d6a61-8f48-4678-bebe-6daedc63c0cb tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6ba7fd30-0a65-4e17-a39f-1dac4e6cfec9 req-092d6a61-8f48-4678-bebe-6daedc63c0cb tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6ba7fd30-0a65-4e17-a39f-1dac4e6cfec9 req-092d6a61-8f48-4678-bebe-6daedc63c0cb tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6ba7fd30-0a65-4e17-a39f-1dac4e6cfec9 req-092d6a61-8f48-4678-bebe-6daedc63c0cb tempest-AttachVolumeTestJSON-1674610177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-736de742-b09c-4bb4-a446-da80ee3c3963', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ae7caee-0388-4f5b-baea-424f82dbe98a', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:35:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6ba7fd30-0a65-4e17-a39f-1dac4e6cfec9 req-092d6a61-8f48-4678-bebe-6daedc63c0cb tempest-AttachVolumeTestJSON-1674610177 None] attachment_update completed successfully. Nov 03 07:35:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=78,cinder:SELECT=85,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=71,cinder:UPDATE=85,cinder:DELETE=11,cinder:INSERT=26 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Flow 'volume_create_manager' (fe495770-90bc-47ec-a289-b3ba8c46ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b2d64c-2382-45ae-8aa3-25a56e1ec48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b2d64c-2382-45ae-8aa3-25a56e1ec48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1396088888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c176a1-046a-4923-81a9-e9f90fd14039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a55bea1c94ca593f14c4d43ab2ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:19Z,use_quota=True,user_id='d667390093ab41549ecaa5ea496b8622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbe8aeb-3e02-4c7d-b8fa-23610cccd0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbe8aeb-3e02-4c7d-b8fa-23610cccd0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8b9597-eda0-4a09-93c2-8ee45309b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8b9597-eda0-4a09-93c2-8ee45309b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c176a1-046a-4923-81a9-e9f90fd14039', 'volume_name': 'volume-68c176a1-046a-4923-81a9-e9f90fd14039', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832e0bee-a5d7-4780-8725-15b6a758e724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832e0bee-a5d7-4780-8725-15b6a758e724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be5ec03-db41-457c-b607-4f6922cc84a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Volume 68c176a1-046a-4923-81a9-e9f90fd14039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c176a1-046a-4923-81a9-e9f90fd14039', 'volume_size': 1} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1396088888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c176a1-046a-4923-81a9-e9f90fd14039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a55bea1c94ca593f14c4d43ab2ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:19Z,use_quota=True,user_id='d667390093ab41549ecaa5ea496b8622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Creating volume 68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:35:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:19 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 1073741824 Nov 03 07:35:19 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:21 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 1073741824" returned: 0 in 1.712s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:21 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 Nov 03 07:35:21 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:22 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039" returned: 0 in 0.822s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] <== create_volume: return (2748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be5ec03-db41-457c-b607-4f6922cc84a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c176a1-046a-4923-81a9-e9f90fd14039', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52f928-9b9e-48b8-9917-d9e3d306c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Volume volume-68c176a1-046a-4923-81a9-e9f90fd14039 (68c176a1-046a-4923-81a9-e9f90fd14039): created successfully Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea52f928-9b9e-48b8-9917-d9e3d306c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Flow 'volume_create_manager' (fe495770-90bc-47ec-a289-b3ba8c46ca93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f938579d-ca39-4140-8144-e1902d6161c0 tempest-VolumesCloneTest-2002096551 None] Created volume successfully. Nov 03 07:35:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Flow 'volume_create_manager' (24e53bf0-6d4b-4256-8005-49958f1186f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6de9759-a225-4b0c-953e-75f9d5c24bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6de9759-a225-4b0c-953e-75f9d5c24bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1720963521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacc5abc-2969-4103-8833-42b2684b1bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a55bea1c94ca593f14c4d43ab2ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=68c176a1-046a-4923-81a9-e9f90fd14039,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:25Z,use_quota=True,user_id='d667390093ab41549ecaa5ea496b8622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd74c2d-135f-412b-8f0a-2a38602ff456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd74c2d-135f-412b-8f0a-2a38602ff456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d217e9-15e5-43f1-a919-178e3fc0fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d217e9-15e5-43f1-a919-178e3fc0fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dacc5abc-2969-4103-8833-42b2684b1bc4', 'volume_name': 'volume-dacc5abc-2969-4103-8833-42b2684b1bc4', 'volume_size': 2, 'source_volid': '68c176a1-046a-4923-81a9-e9f90fd14039', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e5db56-88ca-46fb-a608-2270e9008e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e5db56-88ca-46fb-a608-2270e9008e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc5a053-f084-424b-b7d4-f88e39d00438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Volume dacc5abc-2969-4103-8833-42b2684b1bc4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dacc5abc-2969-4103-8833-42b2684b1bc4', 'volume_size': 2, 'source_volid': '68c176a1-046a-4923-81a9-e9f90fd14039', 'source_volstatus': 'available'} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:25 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Cloning volume 68c176a1-046a-4923-81a9-e9f90fd14039 to volume dacc5abc-2969-4103-8833-42b2684b1bc4 Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Creating offline snapshot 7aeb7a29-0096-4753-9c60-17d277bcbe76 of volume 68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd6abd-bd85-4266-9130-8815933c201b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:25 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 Nov 03 07:35:25 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:26 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:26 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 1G Nov 03 07:35:26 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:27 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 1G" returned: 0 in 0.944s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c176a1-046a-4923-81a9-e9f90fd14039 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:27 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c176a1-046a-4923-81a9-e9f90fd14039 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 Nov 03 07:35:27 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-3fdbba4d-8629-40dc-ba8c-be9272e01256 tempest-ServerActionsTestOtherA-472758879 None] Terminate volume connection completed successfully. Nov 03 07:35:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-3fdbba4d-8629-40dc-ba8c-be9272e01256 tempest-ServerActionsTestOtherA-472758879 None] Deleting attachment 878c8ac7-ccef-4717-801d-b02086f1c984. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:35:27 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c176a1-046a-4923-81a9-e9f90fd14039 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 is being set with open permissions: ugo+rw Nov 03 07:35:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:28 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 Nov 03 07:35:28 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:28 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76" returned: 0 in 0.699s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:28 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info Nov 03 07:35:28 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:29 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info" returned: 0 in 0.856s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:29 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info is being set with open permissions: ugo+rw Nov 03 07:35:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:29 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info Nov 03 07:35:29 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:30 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.info" returned: 0 in 0.618s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Acquiring lock "cinder-quobyte-dacc5abc-2969-4103-8833-42b2684b1bc4" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-dacc5abc-2969-4103-8833-42b2684b1bc4" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] snapshot: 7aeb7a29-0096-4753-9c60-17d277bcbe76, volume: dacc5abc-2969-4103-8833-42b2684b1bc4, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e5ecd4-c9d5-4b60-ae84-16cd96b8d10c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:30 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 Nov 03 07:35:30 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-af1aa34e-f82d-47c8-8083-5b7bc20758ea tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:31 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76" returned: 0 in 0.757s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c176a1-046a-4923-81a9-e9f90fd14039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c1adc0-1c2e-405c-b474-f0d4c9ed35cc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:31 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 Nov 03 07:35:31 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:31 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:35:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:31 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 Nov 03 07:35:31 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:38 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:41 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=2,cinder:SELECT=9,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:41 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4" returned: 0 in 10.037s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:41 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:35:41 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Converted 1024.00 MB image at 102.01 MB/s Nov 03 07:35:41 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 is being set with open permissions: ugo+rw Nov 03 07:35:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:41 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 Nov 03 07:35:41 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-dacc5abc-2969-4103-8833-42b2684b1bc4" released by "_copy_volume_from_snapshot" :: held 11.691s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Acquiring lock "cinder-quobyte-7aeb7a29-0096-4753-9c60-17d277bcbe76" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-7aeb7a29-0096-4753-9c60-17d277bcbe76" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Deleting offline snapshot 7aeb7a29-0096-4753-9c60-17d277bcbe76 of volume 68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] snapshot_file for this snap is: volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed889fc-098f-47f9-b627-f5d840557723]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:42 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 Nov 03 07:35:42 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76" returned: 0 in 0.438s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c176a1-046a-4923-81a9-e9f90fd14039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17b76d-3721-424c-91c3-68fea0670bc3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:42 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 Nov 03 07:35:42 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:43 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:43 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 Nov 03 07:35:43 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:43 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:43 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76 Nov 03 07:35:43 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:43 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039.7aeb7a29-0096-4753-9c60-17d277bcbe76" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-7aeb7a29-0096-4753-9c60-17d277bcbe76" released by "_delete_snapshot" :: held 1.807s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.707s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-af1aa34e-f82d-47c8-8083-5b7bc20758ea tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.711s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-af1aa34e-f82d-47c8-8083-5b7bc20758ea tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc5a053-f084-424b-b7d4-f88e39d00438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacc5abc-2969-4103-8833-42b2684b1bc4', 'volume_size': 2, 'source_volid': '68c176a1-046a-4923-81a9-e9f90fd14039', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af3e0db-3065-4f8e-8e3f-71e6fd496d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Volume volume-dacc5abc-2969-4103-8833-42b2684b1bc4 (dacc5abc-2969-4103-8833-42b2684b1bc4): created successfully Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af3e0db-3065-4f8e-8e3f-71e6fd496d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Flow 'volume_create_manager' (24e53bf0-6d4b-4256-8005-49958f1186f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-af1aa34e-f82d-47c8-8083-5b7bc20758ea tempest-ServerActionsTestOtherA-472758879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f77a8c8-5379-4cbe-9d2c-97b66590dc50', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:35:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-709d192b-d1a6-4ce5-8f86-5b851170b94c tempest-VolumesCloneTest-2002096551 None] Created volume successfully. Nov 03 07:35:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-863d0c61-1b7f-4e80-a731-d0901d3cf41c req-af1aa34e-f82d-47c8-8083-5b7bc20758ea tempest-ServerActionsTestOtherA-472758879 None] attachment_update completed successfully. Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Acquiring lock "cinder-dacc5abc-2969-4103-8833-42b2684b1bc4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Lock "cinder-dacc5abc-2969-4103-8833-42b2684b1bc4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Acquiring lock "cinder-quobyte-dacc5abc-2969-4103-8833-42b2684b1bc4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-dacc5abc-2969-4103-8833-42b2684b1bc4" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[08007ccc-35f6-4f77-a221-0b48a024f7c6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:45 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 Nov 03 07:35:45 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:45 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4" returned: 0 in 0.482s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:45 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4 Nov 03 07:35:45 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:46 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dacc5abc-2969-4103-8833-42b2684b1bc4" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-dacc5abc-2969-4103-8833-42b2684b1bc4" released by "delete_volume" :: held 0.862s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Created reservations ['5036e7b6-8c0c-4743-8a51-4b138d0de0a9', 'af559169-66b5-4317-9e29-96385a597848', 'bcfe52b1-09cd-42a0-be3f-7d9decf7a3f3', '44fd981b-3f33-4de2-8cbe-973e7193a0b7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:46 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:35:46 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Acquiring lock "cinder-68c176a1-046a-4923-81a9-e9f90fd14039-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Lock "cinder-68c176a1-046a-4923-81a9-e9f90fd14039-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:46 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Deleted volume successfully. Nov 03 07:35:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cef31a41-7ac5-425c-a218-b8d3bf01f1a7 tempest-VolumesCloneTest-2002096551 None] Lock "cinder-dacc5abc-2969-4103-8833-42b2684b1bc4-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Acquiring lock "cinder-quobyte-68c176a1-046a-4923-81a9-e9f90fd14039" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-68c176a1-046a-4923-81a9-e9f90fd14039" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1128208-2ff5-4b82-a360-af941b334c28]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:47 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 Nov 03 07:35:47 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:47 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039" returned: 0 in 0.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:47 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039 Nov 03 07:35:47 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:48 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-68c176a1-046a-4923-81a9-e9f90fd14039" returned: 0 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Lock "cinder-quobyte-68c176a1-046a-4923-81a9-e9f90fd14039" released by "delete_volume" :: held 1.163s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Created reservations ['dbe46801-6cbd-4880-b55b-81a39ee47028', 'eae0dc32-7993-4036-a248-da0bc62ad74b', '661922e7-d671-44cf-9997-928e54569b44', '6d02c44d-f3d1-401d-a294-f139a5860d15'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:48 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:35:48 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:49 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Deleted volume successfully. Nov 03 07:35:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9349454b-5ed2-4458-980c-387012c0f7ae tempest-VolumesCloneTest-2002096551 None] Lock "cinder-68c176a1-046a-4923-81a9-e9f90fd14039-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Flow 'volume_create_manager' (3f20ddda-cef2-46fa-ae76-a076d354b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c68fae-8c9f-446a-ab32-925ff0d378a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c68fae-8c9f-446a-ab32-925ff0d378a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-35942822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fb15a3-8767-4c5f-8bb8-00d2db8f2d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870744a75f841ed838d3a9a6700d438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:51Z,use_quota=True,user_id='e672a8b0ef174467b8302bf5fd879a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b022da25-9f7e-4dc9-afb4-55d6571fd1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b022da25-9f7e-4dc9-afb4-55d6571fd1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65631c6d-23bc-40cb-b4d1-bbb42c2c5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65631c6d-23bc-40cb-b4d1-bbb42c2c5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72fb15a3-8767-4c5f-8bb8-00d2db8f2d27', 'volume_name': 'volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793703fb-f94b-492e-9e7b-b8f40eb0f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793703fb-f94b-492e-9e7b-b8f40eb0f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa64cbb-a5b5-42dd-8fc8-d2a908e4ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Volume 72fb15a3-8767-4c5f-8bb8-00d2db8f2d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27', 'volume_size': 1} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-35942822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fb15a3-8767-4c5f-8bb8-00d2db8f2d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3870744a75f841ed838d3a9a6700d438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:51Z,use_quota=True,user_id='e672a8b0ef174467b8302bf5fd879a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Creating volume 72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:35:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:51 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 1073741824 Nov 03 07:35:51 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:52 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 1073741824" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:52 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 Nov 03 07:35:52 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:52 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa64cbb-a5b5-42dd-8fc8-d2a908e4ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941b48d8-d32c-4609-ab35-38013f2cb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Volume volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 (72fb15a3-8767-4c5f-8bb8-00d2db8f2d27): created successfully Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941b48d8-d32c-4609-ab35-38013f2cb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Flow 'volume_create_manager' (3f20ddda-cef2-46fa-ae76-a076d354b11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-264b5b18-a375-4b22-baa3-ab46bbc5d82b tempest-AttachVolumeNegativeTest-1912171583 None] Created volume successfully. Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-398dc699-f312-4901-81da-849876b23471 req-db42e3a4-81d1-4eae-967c-b9e827a55cf6 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-398dc699-f312-4901-81da-849876b23471 req-db42e3a4-81d1-4eae-967c-b9e827a55cf6 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-398dc699-f312-4901-81da-849876b23471 req-db42e3a4-81d1-4eae-967c-b9e827a55cf6 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:54 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:35:54 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-398dc699-f312-4901-81da-849876b23471 req-db42e3a4-81d1-4eae-967c-b9e827a55cf6 tempest-AttachVolumeNegativeTest-1912171583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9b53955-2290-4e0a-b9d3-edda32b10f92', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:35:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-398dc699-f312-4901-81da-849876b23471 req-db42e3a4-81d1-4eae-967c-b9e827a55cf6 tempest-AttachVolumeNegativeTest-1912171583 None] attachment_update completed successfully. Nov 03 07:35:54 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:35:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:35:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-331d09d3-b537-4f29-af75-b74790d9ca5b req-c937f0ff-fc85-4c00-869c-9156de91ff53 tempest-AttachVolumeNegativeTest-1912171583 None] Terminate volume connection completed successfully. Nov 03 07:35:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-331d09d3-b537-4f29-af75-b74790d9ca5b req-c937f0ff-fc85-4c00-869c-9156de91ff53 tempest-AttachVolumeNegativeTest-1912171583 None] Deleting attachment d9b53955-2290-4e0a-b9d3-edda32b10f92. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Flow 'volume_create_manager' (c872651f-41b5-4931-b103-768f23e50228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20975a7f-ca76-469e-bc6b-66607d1ed32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20975a7f-ca76-469e-bc6b-66607d1ed32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1205036715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94ef0602f2042b3912cafc30dd1f39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:01Z,use_quota=True,user_id='c8f34cd7f6974d0fadfddab2d293664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f62d34-a513-4701-9f33-2b82ab9da24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f62d34-a513-4701-9f33-2b82ab9da24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e05664-70eb-48bc-815d-f42c53fd77a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e05664-70eb-48bc-815d-f42c53fd77a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5', 'volume_name': 'volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725606d5-d30a-4986-8ce3-2f15f37a6169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725606d5-d30a-4986-8ce3-2f15f37a6169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513a9284-2ba4-4041-b61b-468ed9ef8324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Volume e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5', 'volume_size': 2} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1205036715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94ef0602f2042b3912cafc30dd1f39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:01Z,use_quota=True,user_id='c8f34cd7f6974d0fadfddab2d293664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Creating volume e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:01 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:36:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 2147483648 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:01 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 2147483648 Nov 03 07:36:01 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8340579b-47dd-4be0-b33c-21c350053928 req-12ba7502-97b0-411d-bff0-2e86e3c3e2d3 tempest-AttachVolumeTestJSON-1674610177 None] Terminate volume connection completed successfully. Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8340579b-47dd-4be0-b33c-21c350053928 req-12ba7502-97b0-411d-bff0-2e86e3c3e2d3 tempest-AttachVolumeTestJSON-1674610177 None] Deleting attachment 5ae7caee-0388-4f5b-baea-424f82dbe98a. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:36:02 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 2147483648" returned: 0 in 0.760s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:02 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 Nov 03 07:36:02 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:02 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513a9284-2ba4-4041-b61b-468ed9ef8324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a967b1d-4670-4cb8-bbbb-1259accc1025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Volume volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 (e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5): created successfully Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a967b1d-4670-4cb8-bbbb-1259accc1025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Flow 'volume_create_manager' (c872651f-41b5-4931-b103-768f23e50228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-245c0e76-cecc-4bc8-9ec5-6291e97c0fd8 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Created volume successfully. Nov 03 07:36:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "cinder-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Creating offline snapshot fba013ea-5d62-4a2c-8630-521a205a4cc7 of volume e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c2af2f-30f7-4ec9-9c0a-41f018a18060]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "cinder-quobyte-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-quobyte-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ec43a7-9d4d-4460-ba12-ddf7006d883a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:04 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 Nov 03 07:36:04 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:04 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 Nov 03 07:36:04 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:04 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" returned: 0 in 0.576s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:04 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:04 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 2G Nov 03 07:36:04 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:04 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27 Nov 03 07:36:04 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:05 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-quobyte-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27" released by "delete_volume" :: held 1.079s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Created reservations ['5c79fea2-0bd8-4cc9-9172-4f869fbaff80', 'd440a890-a794-40bd-8a60-2512da4fe414', '2440cb0b-dcf9-47c2-8cd5-94ab48d8c9ac', 'ea363966-e996-4767-9240-3e9c0dfaa3b6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:05 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 2G" returned: 0 in 0.783s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:05 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 Nov 03 07:36:05 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:05 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:05 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:05 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Deleted volume successfully. Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b0bce23-af38-4c25-8db9-23653fb5c66b tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-72fb15a3-8767-4c5f-8bb8-00d2db8f2d27-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:06 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7" returned: 0 in 0.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:06 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 is being set with open permissions: ugo+rw Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:06 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 Nov 03 07:36:06 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "cinder-89ee7c6b-6570-4c82-b32a-1fb206b60785-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-89ee7c6b-6570-4c82-b32a-1fb206b60785-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "cinder-quobyte-89ee7c6b-6570-4c82-b32a-1fb206b60785" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:06 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7" returned: 0 in 0.575s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-quobyte-89ee7c6b-6570-4c82-b32a-1fb206b60785" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbea5aa-207b-4df1-9594-5316932eb58e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:06 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info Nov 03 07:36:06 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:07 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 Nov 03 07:36:07 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:07 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:07 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info is being set with open permissions: ugo+rw Nov 03 07:36:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:07 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info Nov 03 07:36:07 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:07 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.info" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:07 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.622s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785" returned: 0 in 0.798s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:07 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785 Nov 03 07:36:07 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ec42c003-1af3-48bb-94f9-9967ea6ea678 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Create snapshot completed successfully Nov 03 07:36:08 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89ee7c6b-6570-4c82-b32a-1fb206b60785" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-quobyte-89ee7c6b-6570-4c82-b32a-1fb206b60785" released by "delete_volume" :: held 1.398s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Created reservations ['4a32f6fe-4b94-4c35-b30e-87779c705074', '61ceae41-e9fd-479f-b311-6ef1cdb8cd6d', 'e97721ef-1e2b-4435-b0f6-8834bebceb52', 'adb91fc2-25f1-43b4-8f3b-f4d15fb37264'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:08 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:08 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "cinder-fba013ea-5d62-4a2c-8630-521a205a4cc7-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-fba013ea-5d62-4a2c-8630-521a205a4cc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "cinder-quobyte-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-quobyte-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "cinder-quobyte-fba013ea-5d62-4a2c-8630-521a205a4cc7" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-quobyte-fba013ea-5d62-4a2c-8630-521a205a4cc7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Deleting offline snapshot fba013ea-5d62-4a2c-8630-521a205a4cc7 of volume e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] snapshot_file for this snap is: volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4257bb29-670b-438c-827f-6958af984d93]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:09 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.613s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Deleted volume successfully. Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8117af4-6e14-41ce-84eb-674eaa725d9f tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-89ee7c6b-6570-4c82-b32a-1fb206b60785-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:09 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 Nov 03 07:36:09 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "cinder-1a97f314-269b-4908-a5d7-7ebcd8c89d19-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-1a97f314-269b-4908-a5d7-7ebcd8c89d19-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "cinder-quobyte-1a97f314-269b-4908-a5d7-7ebcd8c89d19" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-quobyte-1a97f314-269b-4908-a5d7-7ebcd8c89d19" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af5f366-f94b-4ec8-8628-6d5f5f54b2ae]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:09 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 Nov 03 07:36:09 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:09 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7" returned: 0 in 0.984s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f227739-35e6-4745-b283-d94e15544b4c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:10 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19" returned: 0 in 0.550s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:10 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 Nov 03 07:36:10 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:10 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19 Nov 03 07:36:10 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:10 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a97f314-269b-4908-a5d7-7ebcd8c89d19" returned: 0 in 0.401s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-quobyte-1a97f314-269b-4908-a5d7-7ebcd8c89d19" released by "delete_volume" :: held 1.008s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:10 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" returned: 0 in 0.707s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Created reservations ['071cad96-e500-44af-975d-8c13996ea64e', '218136da-70fd-4cd7-84d7-fda1a8ce73ca', '4ada6311-c567-47eb-bbeb-dfb49165c11e', '3b1cfa7c-5906-4bbb-8d22-aaa3c86e5e00'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:10 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 Nov 03 07:36:10 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:10 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:10 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:11 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7" returned: 0 in 0.456s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:11 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:11 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7 Nov 03 07:36:11 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Deleted volume successfully. Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fe3d553c-4c6f-434c-9a79-fdf34b434a36 tempest-AttachVolumeNegativeTest-1912171583 None] Lock "cinder-1a97f314-269b-4908-a5d7-7ebcd8c89d19-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:11 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5.fba013ea-5d62-4a2c-8630-521a205a4cc7" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-quobyte-fba013ea-5d62-4a2c-8630-521a205a4cc7" released by "_delete_snapshot" :: held 2.736s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-quobyte-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" released by "delete_snapshot" :: held 2.777s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Created reservations ['88463e4e-3804-46a2-b1b3-62d189de8e82', '86befc1c-1bbc-473e-a438-1e0449da69c4', '85c00426-f46f-4e20-99bf-17094ea58c62', '111d9d29-321b-4e66-9e46-5260c1d7a82f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Delete snapshot completed successfully. Nov 03 07:36:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123515f1-f704-478c-8563-2752c1e436cc tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-fba013ea-5d62-4a2c-8630-521a205a4cc7-delete_snapshot" released by "delete_snapshot" :: held 2.959s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "cinder-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "cinder-quobyte-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-quobyte-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f9c12-1bf1-4087-a13f-608b5381e394]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:12 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 Nov 03 07:36:12 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:12 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" returned: 0 in 0.584s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:12 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5 Nov 03 07:36:12 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:13 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-quobyte-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5" released by "delete_volume" :: held 1.115s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Created reservations ['ad4ec6a8-c92d-4cc7-bb9f-3a4565ee9915', '89069ad0-cfc3-4f24-bab6-ae5c13275072', '13ca6bda-2e1d-4f0b-a75b-8d61fdd1bf16', '23cc43de-925e-437e-b03e-e96114b5fdd2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:13 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:13 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:13 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Deleted volume successfully. Nov 03 07:36:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-313592f2-086b-4c7f-bd7f-159de98e0515 tempest-VolumesSnapshotNegativeTestJSON-64276963 None] Lock "cinder-e63fa2b7-9b4c-4bf1-9d7d-4f24413d86d5-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-749014c9-088f-4903-8643-b44a23b1919b tempest-ServerActionsTestOtherA-472758879 None] Terminate volume connection completed successfully. Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-749014c9-088f-4903-8643-b44a23b1919b tempest-ServerActionsTestOtherA-472758879 None] Deleting attachment 3f77a8c8-5379-4cbe-9d2c-97b66590dc50. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "cinder-2f6237cf-ff1c-48b6-81f9-fa4618ea5460-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-2f6237cf-ff1c-48b6-81f9-fa4618ea5460-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "cinder-quobyte-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-quobyte-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" acquired by "delete_volume" :: waited 0.087s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4060fadf-b76d-4d5f-8a9d-b5ebd21cd7da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:20 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 Nov 03 07:36:20 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:20 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" returned: 0 in 0.953s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "cinder-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:20 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460 Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:20 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "cinder-quobyte-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-quobyte-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfd3825-1c1e-4fd9-8c96-f5b49087911c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:21 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 Nov 03 07:36:21 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:21 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" returned: 0 in 0.638s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-quobyte-2f6237cf-ff1c-48b6-81f9-fa4618ea5460" released by "delete_volume" :: held 1.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG cinder.quota [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Created reservations ['a5f51088-dfab-41bb-a518-61b7876551d1', '2a8595eb-9133-4ca3-a557-34d64043b7a0', 'c5b98f2d-ad78-46be-b0eb-2e1731b8438a', '4245b138-53cf-46d7-859e-72dff6e1a99c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:21 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:21 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:21 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285" returned: 0 in 0.858s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:21 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285 Nov 03 07:36:21 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:22 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.511s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.manager [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Deleted volume successfully. Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-5cac9ca6-445d-43aa-849a-535037ef5d90 req-b27a3af9-bb6a-416d-b9b0-fad37e7aae5e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-2f6237cf-ff1c-48b6-81f9-fa4618ea5460-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:22 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285" returned: 0 in 0.471s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-quobyte-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285" released by "delete_volume" :: held 1.419s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Created reservations ['8bfd965b-f752-40ef-9d41-8e0baaa1cd7b', 'de94f061-62f2-4cfc-806d-9d2f1b063f01', '6215ca02-6b1c-4688-8d1b-e1f5835e32c3', '02157a91-941b-4314-bad0-b55238808c34'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:22 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:22 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:22 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Deleted volume successfully. Nov 03 07:36:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c9367234-3793-45e4-8d6b-39ee046d930e tempest-ServerActionsTestOtherA-472758879 None] Lock "cinder-52ef7eba-7ba8-497e-b2eb-cc3cb0e79285-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b259567-6fc9-447e-833c-987c1202de0a tempest-BackendsCapabilitiesAdminTestsJSON-117104691 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7365684509277, 'free_capacity_gb': 1773.7365684509277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:36:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-471cace9-2b05-4b9e-8e52-9532cde54c08 tempest-BackendsCapabilitiesAdminTestsJSON-117104691 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7365684509277, 'free_capacity_gb': 1773.7365684509277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:36:32 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=84,cinder:SELECT=69,cinder:DELETE=5,cinder:INSERT=18 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:36:32 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=83,cinder:SELECT=69,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:36:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55c686c7-3502-443a-9157-171b63b259f6 tempest-GroupSnapshotsTest-1288198965 None] Group tempest-GroupSnapshotsTest-Group-656977657: creating Nov 03 07:36:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55c686c7-3502-443a-9157-171b63b259f6 tempest-GroupSnapshotsTest-1288198965 None] Group tempest-GroupSnapshotsTest-Group-656977657: created successfully Nov 03 07:36:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55c686c7-3502-443a-9157-171b63b259f6 tempest-GroupSnapshotsTest-1288198965 None] Create group completed successfully. Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (9bd91e46-34f2-419a-be49-ab7ae78f18e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c04f0f7-4135-4eaf-81d9-f802e817dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c04f0f7-4135-4eaf-81d9-f802e817dac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723693285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceef3691-a0be-4e2f-940b-d4b6b462b9d4,host='devstack@QuobyteHD#QuobyteHD',id=196c6635-cf34-47a1-bf2d-417b3c4501c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:42Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a1c6c3e-80d6-4281-bd13-5e9c6e04e467),volume_type_id=8a1c6c3e-80d6-4281-bd13-5e9c6e04e467)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0106155-eb19-406a-8e22-d1ea2b686bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0106155-eb19-406a-8e22-d1ea2b686bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9686a0-57fd-45cf-b143-3cf94b83b743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9686a0-57fd-45cf-b143-3cf94b83b743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196c6635-cf34-47a1-bf2d-417b3c4501c5', 'volume_name': 'volume-196c6635-cf34-47a1-bf2d-417b3c4501c5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db175c08-a98a-445f-ba8e-62a4af70970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db175c08-a98a-445f-ba8e-62a4af70970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e895da-6889-49ea-948a-7b958e26e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Volume 196c6635-cf34-47a1-bf2d-417b3c4501c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196c6635-cf34-47a1-bf2d-417b3c4501c5', 'volume_size': 1} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ceef3691-a0be-4e2f-940b-d4b6b462b9d4,created_at=2026-11-03T06:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723693285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceef3691-a0be-4e2f-940b-d4b6b462b9d4,host='devstack@QuobyteHD#QuobyteHD',id=196c6635-cf34-47a1-bf2d-417b3c4501c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:42Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a1c6c3e-80d6-4281-bd13-5e9c6e04e467),volume_type_id=8a1c6c3e-80d6-4281-bd13-5e9c6e04e467)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Creating volume 196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:36:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:42 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 1073741824 Nov 03 07:36:42 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:43 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 1073741824" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:43 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 Nov 03 07:36:43 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:43 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e895da-6889-49ea-948a-7b958e26e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196c6635-cf34-47a1-bf2d-417b3c4501c5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0cee1a-1037-472b-9217-117679810035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Volume volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 (196c6635-cf34-47a1-bf2d-417b3c4501c5): created successfully Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0cee1a-1037-472b-9217-117679810035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (9bd91e46-34f2-419a-be49-ab7ae78f18e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eb5766ed-bb4f-439b-a7fb-c3132fac3779 tempest-GroupSnapshotsTest-1288198965 None] Created volume successfully. Nov 03 07:36:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] GroupSnapshot c6273173-2551-4766-8e23-f4c5698addc5: creating. Nov 03 07:36:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Group snapshot c6273173-2551-4766-8e23-f4c5698addc5: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:36:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Creating offline snapshot ad9d1888-43ae-4e57-a677-116eed7d62a9 of volume 196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:36:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fef1bf-5cbd-451a-85d3-9954b0ba5e1a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:45 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 Nov 03 07:36:45 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:46 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:46 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 1G Nov 03 07:36:46 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:46 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 1G" returned: 0 in 0.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:46 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 Nov 03 07:36:46 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:47 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:47 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:36:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:47 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 Nov 03 07:36:47 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:47 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9" returned: 0 in 0.637s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:47 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info Nov 03 07:36:47 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:48 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info" returned: 0 in 0.357s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:48 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:36:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:48 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info Nov 03 07:36:48 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:48 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.info" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.068s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b7b5379a-54b4-418d-be1d-d4debbcb43e0 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot c6273173-2551-4766-8e23-f4c5698addc5: created successfully Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-ad9d1888-43ae-4e57-a677-116eed7d62a9-cefb2c68-6ab9-4d2f-851a-75ea8415a273" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-ad9d1888-43ae-4e57-a677-116eed7d62a9-cefb2c68-6ab9-4d2f-851a-75ea8415a273" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Creating volume cefb2c68-6ab9-4d2f-851a-75ea8415a273 from snapshot ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-cefb2c68-6ab9-4d2f-851a-75ea8415a273" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-cefb2c68-6ab9-4d2f-851a-75ea8415a273" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] snapshot: ad9d1888-43ae-4e57-a677-116eed7d62a9, volume: cefb2c68-6ab9-4d2f-851a-75ea8415a273, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59e39b3-adbb-44a1-b249-7085c286dad0]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:51 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 Nov 03 07:36:51 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:51 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9" returned: 0 in 0.486s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196c6635-cf34-47a1-bf2d-417b3c4501c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2290bf88-020e-48ab-8cd9-1bf8fed8bf39]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:52 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 Nov 03 07:36:52 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:52 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:36:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:36:52 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:36:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:52 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 Nov 03 07:36:52 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:54 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:36:54 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:54 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.589s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:55 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:36:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:36:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:37:01 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=6,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:37:01 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:37:02 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273" returned: 0 in 10.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:02 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5, size 1024.00 MB, duration 10.34 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:37:02 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Converted 1024.00 MB image at 99.01 MB/s Nov 03 07:37:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:37:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:02 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 Nov 03 07:37:02 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:03 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273" returned: 0 in 0.438s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-cefb2c68-6ab9-4d2f-851a-75ea8415a273" released by "_copy_volume_from_snapshot" :: held 11.916s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-ad9d1888-43ae-4e57-a677-116eed7d62a9-cefb2c68-6ab9-4d2f-851a-75ea8415a273" released by "_create_volume_from_snapshot" :: held 12.061s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.126s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9775ef2-467e-4e95-90e5-ae8ab4f92728 tempest-GroupSnapshotsTest-1288198965 None] Create group from source-snapshot-c6273173-2551-4766-8e23-f4c5698addc5 completed successfully. Nov 03 07:37:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-cefb2c68-6ab9-4d2f-851a-75ea8415a273" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-cefb2c68-6ab9-4d2f-851a-75ea8415a273" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ff004-d96e-4796-aba6-04dfccf8fd4e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:05 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 Nov 03 07:37:05 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:06 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273" returned: 0 in 0.497s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:06 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273 Nov 03 07:37:06 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:06 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cefb2c68-6ab9-4d2f-851a-75ea8415a273" returned: 0 in 0.428s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-cefb2c68-6ab9-4d2f-851a-75ea8415a273" released by "delete_volume" :: held 1.040s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['66ac6ff1-f278-4ea6-bcba-e8e2672cebf8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:06 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-572539014 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-572539014, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:06 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-572539014 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-572539014, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['2b0fb514-584f-4c84-83a4-8570897c088c', '4323f30b-d57d-475b-9cf6-730f1301c44a', '109fedab-c3d6-44d2-9025-6352f687f117', 'cf0c65b0-9d41-482b-b5c6-900477c9af49'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:07 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:37:07 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:07 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:07 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f22de4c-294b-400a-af99-43d3b64ba8f5 tempest-GroupSnapshotsTest-1288198965 None] Delete group completed successfully. Nov 03 07:37:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot c6273173-2551-4766-8e23-f4c5698addc5: deleting Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot c6273173-2551-4766-8e23-f4c5698addc5: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-196c6635-cf34-47a1-bf2d-417b3c4501c5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-196c6635-cf34-47a1-bf2d-417b3c4501c5" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-ad9d1888-43ae-4e57-a677-116eed7d62a9" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-ad9d1888-43ae-4e57-a677-116eed7d62a9" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Deleting offline snapshot ad9d1888-43ae-4e57-a677-116eed7d62a9 of volume 196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] snapshot_file for this snap is: volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7dced-4287-4774-b540-df486dd90936]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:08 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 Nov 03 07:37:08 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:09 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9" returned: 0 in 0.694s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196c6635-cf34-47a1-bf2d-417b3c4501c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:37:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c482b4-221c-4f90-901f-a9430bbf433a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:09 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 Nov 03 07:37:09 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:10 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5" returned: 0 in 0.821s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:10 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 Nov 03 07:37:10 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:10 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9" returned: 0 in 0.542s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:10 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9 Nov 03 07:37:10 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:11 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5.ad9d1888-43ae-4e57-a677-116eed7d62a9" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-ad9d1888-43ae-4e57-a677-116eed7d62a9" released by "_delete_snapshot" :: held 2.676s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-196c6635-cf34-47a1-bf2d-417b3c4501c5" released by "delete_snapshot" :: held 2.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:11 devstack cinder-volume[86916]: WARNING cinder.quota [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-572539014 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-572539014, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['f47dc239-3f3a-46f1-92be-a6c84b144731', '941d0bac-c6ce-4da9-9584-82597ed16348', '88182df1-4441-437b-b928-fbd4db5f3128', 'd0041b88-7b38-4bed-8ed3-2a3fcbda75f0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-896882c5-1271-4489-8525-67484e004f71 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot c6273173-2551-4766-8e23-f4c5698addc5: deleted successfully Nov 03 07:37:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-196c6635-cf34-47a1-bf2d-417b3c4501c5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-196c6635-cf34-47a1-bf2d-417b3c4501c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1eafe8-7e7f-413b-85f6-2d749418397a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:12 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 Nov 03 07:37:12 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:13 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5" returned: 0 in 0.693s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:13 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5 Nov 03 07:37:13 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:14 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-196c6635-cf34-47a1-bf2d-417b3c4501c5" returned: 0 in 0.837s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-196c6635-cf34-47a1-bf2d-417b3c4501c5" released by "delete_volume" :: held 1.691s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['52b841fd-e4a2-48df-94ba-7ee5b956da92'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:14 devstack cinder-volume[86916]: WARNING cinder.db.api [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-572539014'] Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['ea194877-0b3a-4a61-926b-d607a4f26eee', 'b9c65ed5-9a6f-44d9-9c30-f5f914c016e8', 'dd083258-3ad2-4113-b66a-0371375646d3', '78ff88da-6690-4f13-99c3-1ed5a1105583'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:14 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:37:14 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:15 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.467s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:15 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-54ac0fd3-590a-421a-8579-6834351c5c3e tempest-GroupSnapshotsTest-1288198965 None] Delete group completed successfully. Nov 03 07:37:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c09c3d40-5e7c-43ad-935d-483619f34338 tempest-GroupSnapshotsTest-1288198965 None] Group tempest-GroupSnapshotsTest-Group-501049442: creating Nov 03 07:37:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c09c3d40-5e7c-43ad-935d-483619f34338 tempest-GroupSnapshotsTest-1288198965 None] Group tempest-GroupSnapshotsTest-Group-501049442: created successfully Nov 03 07:37:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c09c3d40-5e7c-43ad-935d-483619f34338 tempest-GroupSnapshotsTest-1288198965 None] Create group completed successfully. Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (3c4ce256-300c-4191-89db-07b3cf53ec23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f72e129-e8d0-46b2-a49f-5aeffb0acd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f72e129-e8d0-46b2-a49f-5aeffb0acd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-500763415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42a89aaf-c0a7-4682-b36f-5c3267f43d9a,host='devstack@QuobyteHD#QuobyteHD',id=82d84d59-fbec-496e-adb8-6c8a7cb599b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:21Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b747cd63-0c11-4963-8138-c3f82fda2f4f),volume_type_id=b747cd63-0c11-4963-8138-c3f82fda2f4f)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f619f7-f1ac-43f5-a62e-c02f42d79ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f619f7-f1ac-43f5-a62e-c02f42d79ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9567b75e-3aa7-40b3-9d50-5113497079ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9567b75e-3aa7-40b3-9d50-5113497079ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d84d59-fbec-496e-adb8-6c8a7cb599b8', 'volume_name': 'volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455f328b-48b5-4e76-b062-f67061a840bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455f328b-48b5-4e76-b062-f67061a840bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83226a8-7663-4f37-bf8b-2f55e4cf1609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Volume 82d84d59-fbec-496e-adb8-6c8a7cb599b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8', 'volume_size': 1} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42a89aaf-c0a7-4682-b36f-5c3267f43d9a,created_at=2026-11-03T06:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-500763415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42a89aaf-c0a7-4682-b36f-5c3267f43d9a,host='devstack@QuobyteHD#QuobyteHD',id=82d84d59-fbec-496e-adb8-6c8a7cb599b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:21Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b747cd63-0c11-4963-8138-c3f82fda2f4f),volume_type_id=b747cd63-0c11-4963-8138-c3f82fda2f4f)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Creating volume 82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:37:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:21 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 1073741824 Nov 03 07:37:21 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:22 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 1073741824" returned: 0 in 1.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:22 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 Nov 03 07:37:22 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:23 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83226a8-7663-4f37-bf8b-2f55e4cf1609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11c3825-1242-40ec-86fa-bdf3a9503c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Volume volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 (82d84d59-fbec-496e-adb8-6c8a7cb599b8): created successfully Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11c3825-1242-40ec-86fa-bdf3a9503c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (3c4ce256-300c-4191-89db-07b3cf53ec23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce89e34f-4be0-4a41-92e8-642ca2ed433a tempest-GroupSnapshotsTest-1288198965 None] Created volume successfully. Nov 03 07:37:26 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (cc58ebeb-dd72-42d5-aec4-fa25de7b4be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e15dd1e-9710-4ae1-b399-81f0c50dd24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e15dd1e-9710-4ae1-b399-81f0c50dd24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1060784446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42a89aaf-c0a7-4682-b36f-5c3267f43d9a,host='devstack@QuobyteHD#QuobyteHD',id=f32d928d-dc8f-4692-9007-9dcc7c6bb622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:27Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b747cd63-0c11-4963-8138-c3f82fda2f4f),volume_type_id=b747cd63-0c11-4963-8138-c3f82fda2f4f)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f036bb47-38ae-426f-9e65-ba1435f3b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f036bb47-38ae-426f-9e65-ba1435f3b383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629f3a4-ccfc-492c-b373-31f9e343fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629f3a4-ccfc-492c-b373-31f9e343fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32d928d-dc8f-4692-9007-9dcc7c6bb622', 'volume_name': 'volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6664af17-a614-4a80-813e-8a65615238d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6664af17-a614-4a80-813e-8a65615238d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9a34ec-f09a-4fa0-9835-33c581453ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Volume f32d928d-dc8f-4692-9007-9dcc7c6bb622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622', 'volume_size': 1} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42a89aaf-c0a7-4682-b36f-5c3267f43d9a,created_at=2026-11-03T06:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1060784446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42a89aaf-c0a7-4682-b36f-5c3267f43d9a,host='devstack@QuobyteHD#QuobyteHD',id=f32d928d-dc8f-4692-9007-9dcc7c6bb622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:27Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b747cd63-0c11-4963-8138-c3f82fda2f4f),volume_type_id=b747cd63-0c11-4963-8138-c3f82fda2f4f)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Creating volume f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:37:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:27 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 1073741824 Nov 03 07:37:27 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Flow 'volume_create_manager' (419d2716-a086-4d08-834e-44de1c7e8465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1d44a7-48e5-4e16-b614-d2da9092bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1d44a7-48e5-4e16-b614-d2da9092bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-672776987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ea4781-f3ba-4e3f-a953-f630ee390633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe5b898887148829cbbf078f99a9593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:28Z,use_quota=True,user_id='774d18f0c19142ec824e4143af166e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c382af-499e-4a08-a863-92a4942d81e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c382af-499e-4a08-a863-92a4942d81e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7b22c5-43db-49fe-ac8a-68f91f356cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7b22c5-43db-49fe-ac8a-68f91f356cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ea4781-f3ba-4e3f-a953-f630ee390633', 'volume_name': 'volume-27ea4781-f3ba-4e3f-a953-f630ee390633', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8694c1-c197-459f-9e7e-0470c529163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8694c1-c197-459f-9e7e-0470c529163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d58dab-7231-453b-8eed-916cf08312bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Volume 27ea4781-f3ba-4e3f-a953-f630ee390633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ea4781-f3ba-4e3f-a953-f630ee390633', 'volume_size': 1} Nov 03 07:37:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:29 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 1073741824" returned: 0 in 2.011s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:29 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 Nov 03 07:37:29 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:30 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622" returned: 0 in 0.860s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] <== create_volume: return (3054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.059s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-672776987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ea4781-f3ba-4e3f-a953-f630ee390633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe5b898887148829cbbf078f99a9593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:28Z,use_quota=True,user_id='774d18f0c19142ec824e4143af166e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Creating volume 27ea4781-f3ba-4e3f-a953-f630ee390633 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9a34ec-f09a-4fa0-9835-33c581453ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d21dc74-6dbe-4bbc-a646-8754db127c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:30 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 1073741824 Nov 03 07:37:30 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Volume volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 (f32d928d-dc8f-4692-9007-9dcc7c6bb622): created successfully Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d21dc74-6dbe-4bbc-a646-8754db127c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (cc58ebeb-dd72-42d5-aec4-fa25de7b4be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-38cb155a-5034-42c9-a1a2-16355ebb14f0 tempest-GroupSnapshotsTest-1288198965 None] Created volume successfully. Nov 03 07:37:31 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 1073741824" returned: 0 in 1.226s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:32 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 Nov 03 07:37:32 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:32 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d58dab-7231-453b-8eed-916cf08312bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ea4781-f3ba-4e3f-a953-f630ee390633', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc28be1-eaf5-42fd-87f3-8a19e97661e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Volume volume-27ea4781-f3ba-4e3f-a953-f630ee390633 (27ea4781-f3ba-4e3f-a953-f630ee390633): created successfully Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc28be1-eaf5-42fd-87f3-8a19e97661e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Flow 'volume_create_manager' (419d2716-a086-4d08-834e-44de1c7e8465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-62670f9b-b12f-4e43-b571-7caa934c3c98 tempest-TestMinimumBasicScenario-487080026 None] Created volume successfully. Nov 03 07:37:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-19ee6189-1830-4c6e-aa9f-336a39ba20d0 tempest-GroupSnapshotsTest-1288198965 None] Update group completed successfully. Nov 03 07:37:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1696c6af-b854-4a09-8116-6e80de97155a tempest-GroupSnapshotsTest-1288198965 None] Update group completed successfully. Nov 03 07:37:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3a49681e-1751-44ea-a46a-c147c6d18b28 tempest-GroupSnapshotsTest-1288198965 None] Update group completed successfully. Nov 03 07:37:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4590afbe-c9cc-4ba8-bf60-c4d2fe4af79a req-a20bb380-419f-411c-bc4d-d721bffb7939 tempest-TestMinimumBasicScenario-487080026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4590afbe-c9cc-4ba8-bf60-c4d2fe4af79a req-a20bb380-419f-411c-bc4d-d721bffb7939 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4590afbe-c9cc-4ba8-bf60-c4d2fe4af79a req-a20bb380-419f-411c-bc4d-d721bffb7939 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-4590afbe-c9cc-4ba8-bf60-c4d2fe4af79a req-a20bb380-419f-411c-bc4d-d721bffb7939 tempest-TestMinimumBasicScenario-487080026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-27ea4781-f3ba-4e3f-a953-f630ee390633', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '544b2412-0651-4eb0-ab76-65fb630ae661', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:37:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-4590afbe-c9cc-4ba8-bf60-c4d2fe4af79a req-a20bb380-419f-411c-bc4d-d721bffb7939 tempest-TestMinimumBasicScenario-487080026 None] attachment_update completed successfully. Nov 03 07:37:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5c967683-4a8e-426b-bb70-f1c3616ea613 tempest-GroupSnapshotsTest-1288198965 None] Update group completed successfully. Nov 03 07:37:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] GroupSnapshot f82aace5-bacf-4e69-ae19-7e1c9101a49f: creating. Nov 03 07:37:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Group snapshot f82aace5-bacf-4e69-ae19-7e1c9101a49f: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:37:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Creating offline snapshot 010c41fd-d6a4-440b-98ad-de4308d80ee4 of volume 82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:37:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ac1e0-4359-4eeb-8dad-03fbc23dc6ae]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:40 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 Nov 03 07:37:40 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:41 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8" returned: 0 in 0.860s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:41 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 1G Nov 03 07:37:41 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Flow 'volume_create_manager' (a47c157a-c260-4133-aa7b-c7f83459d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93433587-9f51-4dfb-80df-6e050d100ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93433587-9f51-4dfb-80df-6e050d100ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1383856817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2f30c5-e59e-4569-b1b4-ec75893f3627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f86c9187398405994c9e6af91235f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:41Z,use_quota=True,user_id='8c94b06a34f04594b0b44a1a656ea028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ce57d-8ad2-4519-88ce-36524ce72b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ce57d-8ad2-4519-88ce-36524ce72b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3b7a5e-8da7-4df3-81cc-d4c2b41d8496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3b7a5e-8da7-4df3-81cc-d4c2b41d8496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2f30c5-e59e-4569-b1b4-ec75893f3627', 'volume_name': 'volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acebc3f-1b0e-4a6d-a5c2-5f64602192f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acebc3f-1b0e-4a6d-a5c2-5f64602192f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e75514-3e3c-4658-b4ca-bf356c343b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Volume 4b2f30c5-e59e-4569-b1b4-ec75893f3627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627', 'volume_size': 1} Nov 03 07:37:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:42 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 1G" returned: 0 in 0.824s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:42 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 Nov 03 07:37:42 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:42 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4" returned: 0 in 0.728s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:42 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:37:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:42 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 Nov 03 07:37:42 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:43 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:43 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info Nov 03 07:37:43 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:43 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:43 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:37:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:43 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info Nov 03 07:37:43 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:44 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.info" returned: 0 in 0.606s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Creating offline snapshot 8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 of volume f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf9acf4-7483-43f9-8dff-69e1624dd00d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:44 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 Nov 03 07:37:44 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:45 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622" returned: 0 in 0.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:45 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 1G Nov 03 07:37:45 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:46 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 1G" returned: 0 in 1.248s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:46 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 Nov 03 07:37:46 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:47 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" returned: 0 in 0.830s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:47 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:37:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:47 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 Nov 03 07:37:47 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:48 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" returned: 0 in 0.675s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:48 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info Nov 03 07:37:48 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:48 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:48 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:37:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:48 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info Nov 03 07:37:48 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:49 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.info" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.785s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.756s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1383856817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2f30c5-e59e-4569-b1b4-ec75893f3627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f86c9187398405994c9e6af91235f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:41Z,use_quota=True,user_id='8c94b06a34f04594b0b44a1a656ea028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Creating volume 4b2f30c5-e59e-4569-b1b4-ec75893f3627 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:37:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:49 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 1073741824 Nov 03 07:37:49 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0a243764-767d-483a-9008-615ab662fb9c tempest-GroupSnapshotsTest-1288198965 None] group_snapshot f82aace5-bacf-4e69-ae19-7e1c9101a49f: created successfully Nov 03 07:37:50 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 1073741824" returned: 0 in 1.051s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:50 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 Nov 03 07:37:50 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot f82aace5-bacf-4e69-ae19-7e1c9101a49f: deleting Nov 03 07:37:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot f82aace5-bacf-4e69-ae19-7e1c9101a49f: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:37:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-82d84d59-fbec-496e-adb8-6c8a7cb599b8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-82d84d59-fbec-496e-adb8-6c8a7cb599b8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-010c41fd-d6a4-440b-98ad-de4308d80ee4" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-010c41fd-d6a4-440b-98ad-de4308d80ee4" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Deleting offline snapshot 010c41fd-d6a4-440b-98ad-de4308d80ee4 of volume 82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:37:51 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] snapshot_file for this snap is: volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627" returned: 0 in 0.725s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc6ae6-5ae8-4a0d-9040-46db0e5f65db]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e75514-3e3c-4658-b4ca-bf356c343b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702c5e23-9f91-4ca2-8675-a412ae126688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Volume volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 (4b2f30c5-e59e-4569-b1b4-ec75893f3627): created successfully Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702c5e23-9f91-4ca2-8675-a412ae126688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Flow 'volume_create_manager' (a47c157a-c260-4133-aa7b-c7f83459d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f9379fef-8128-490a-a95d-3f39c7bfd01d tempest-ServerRescueNegativeTestJSON-1107800310 None] Created volume successfully. Nov 03 07:37:51 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 Nov 03 07:37:51 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:51 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4" returned: 0 in 0.837s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:37:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0c0f99-9c0a-42fe-9223-816e7cc17981]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:52 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 Nov 03 07:37:52 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:52 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:52 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 Nov 03 07:37:52 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:53 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4" returned: 0 in 0.528s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:53 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4 Nov 03 07:37:53 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:53 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8.010c41fd-d6a4-440b-98ad-de4308d80ee4" returned: 0 in 0.569s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-010c41fd-d6a4-440b-98ad-de4308d80ee4" released by "_delete_snapshot" :: held 2.940s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-82d84d59-fbec-496e-adb8-6c8a7cb599b8" released by "delete_snapshot" :: held 2.995s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-f32d928d-dc8f-4692-9007-9dcc7c6bb622" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-f32d928d-dc8f-4692-9007-9dcc7c6bb622" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Deleting offline snapshot 8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 of volume f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] snapshot_file for this snap is: volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[31324e3c-d997-4690-9326-8eb7ec68a0ac]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:54 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 Nov 03 07:37:54 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:54 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:37:54 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:54 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:37:54 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" returned: 0 in 0.722s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dc671c-ddba-4ac5-9f89-571155b997d1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:55 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 Nov 03 07:37:55 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:55 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622" returned: 0 in 0.594s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:55 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 Nov 03 07:37:55 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:56 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" returned: 0 in 0.534s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:56 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10 Nov 03 07:37:56 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:56 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622.8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-8dfe1d99-7d35-49c3-acb3-c9e711cf0a10" released by "_delete_snapshot" :: held 2.322s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-f32d928d-dc8f-4692-9007-9dcc7c6bb622" released by "delete_snapshot" :: held 2.353s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:56 devstack cinder-volume[86916]: WARNING cinder.quota [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1770874738 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1770874738, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:56 devstack cinder-volume[86916]: WARNING cinder.quota [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1770874738 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1770874738, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['c5f6120d-b319-49af-a87c-d0e37d1d0c86', '56be3a22-8192-4371-af7c-e6824a4c53da', '51cf9e86-9731-4597-8da6-2a689d022c47', '78bb5c7c-2c25-4297-a9d5-a848bc8b53e0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['430f7008-1f1f-423d-b68b-c33134055eb8', 'd1966cf6-37ea-4322-a6a2-3320f1869003', 'eaf1658a-9780-40aa-a7c0-7204a03fe921', '0457715b-0743-4932-8300-f222a019a4ff'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-04c53e02-e414-4e24-baa8-964d4f12bc52 tempest-GroupSnapshotsTest-1288198965 None] group_snapshot f82aace5-bacf-4e69-ae19-7e1c9101a49f: deleted successfully Nov 03 07:37:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-82d84d59-fbec-496e-adb8-6c8a7cb599b8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-82d84d59-fbec-496e-adb8-6c8a7cb599b8" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d53e907-7556-4e68-a8db-9a43740c72c5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:58 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 Nov 03 07:37:58 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:58 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8" returned: 0 in 0.476s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:58 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8 Nov 03 07:37:58 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:58 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-82d84d59-fbec-496e-adb8-6c8a7cb599b8" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-82d84d59-fbec-496e-adb8-6c8a7cb599b8" released by "delete_volume" :: held 1.006s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-f32d928d-dc8f-4692-9007-9dcc7c6bb622" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-f32d928d-dc8f-4692-9007-9dcc7c6bb622" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce3258-3e28-45ec-8438-385e79722701]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:59 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 Nov 03 07:37:59 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:59 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:59 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622 Nov 03 07:37:59 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:59 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f32d928d-dc8f-4692-9007-9dcc7c6bb622" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-f32d928d-dc8f-4692-9007-9dcc7c6bb622" released by "delete_volume" :: held 0.933s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['19dd2bff-345c-4169-af52-a56f8aa14267'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:59 devstack cinder-volume[86916]: WARNING cinder.quota [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1770874738 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1770874738, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['aeca7084-5977-466e-ab7d-6e762f67e188', '054e795e-36b6-411f-9f2e-35ab98813962', '396cfffb-1b77-49b0-b023-0974d14de190', 'b69e3ce2-10c4-401b-b322-7a1a2a73b3ab'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['42504d0f-184a-4fa9-b9b3-da4c7403cf74', '34b038b3-159e-4a92-a6ff-2627c539cc31', '741fc988-7218-4871-8813-ea3bed6f6def', 'f48cd6b1-f91e-4eda-9a8b-68b3a355e67c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:00 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:00 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:00 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cd85030c-4bf9-4a15-90eb-3c50c8bd3324 tempest-GroupSnapshotsTest-1288198965 None] Delete group completed successfully. Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Acquiring lock "cinder-4b2f30c5-e59e-4569-b1b4-ec75893f3627-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "cinder-4b2f30c5-e59e-4569-b1b4-ec75893f3627-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Acquiring lock "cinder-quobyte-4b2f30c5-e59e-4569-b1b4-ec75893f3627" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "cinder-quobyte-4b2f30c5-e59e-4569-b1b4-ec75893f3627" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae7752-5816-45e1-bd77-647aed43bc8a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-509b32c7-006a-4ab4-936c-9a1a325b0c85 tempest-GroupSnapshotsTest-1288198965 None] Group tempest-GroupSnapshotsTest-Group-379249099: creating Nov 03 07:38:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-509b32c7-006a-4ab4-936c-9a1a325b0c85 tempest-GroupSnapshotsTest-1288198965 None] Group tempest-GroupSnapshotsTest-Group-379249099: created successfully Nov 03 07:38:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-509b32c7-006a-4ab4-936c-9a1a325b0c85 tempest-GroupSnapshotsTest-1288198965 None] Create group completed successfully. Nov 03 07:38:01 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 Nov 03 07:38:01 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:01 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627" returned: 0 in 0.653s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:01 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627 Nov 03 07:38:01 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:02 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b2f30c5-e59e-4569-b1b4-ec75893f3627" returned: 0 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "cinder-quobyte-4b2f30c5-e59e-4569-b1b4-ec75893f3627" released by "delete_volume" :: held 1.077s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=92,cinder:SELECT=76,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=98,cinder:UPDATE=76,cinder:INSERT=23,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Created reservations ['69bc6b12-a3c2-48c7-aeb0-b698a7081ff9', '4fc3518c-6066-4f3a-b922-21e9957da4c9', '73a9f22a-fc97-4cda-aedc-5305ee254b7a', '3ed04ff6-b2db-443c-9e89-b212c0ef8588'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:02 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:02 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:02 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Deleted volume successfully. Nov 03 07:38:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42bfaf8a-9a66-442f-b7cd-e8d93c4c2e9f tempest-ServerRescueNegativeTestJSON-1107800310 None] Lock "cinder-4b2f30c5-e59e-4569-b1b4-ec75893f3627-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (4378d16c-f9fd-443a-9aa9-8ba68aa5dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda716e2-022e-4a75-8066-a0384a394d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda716e2-022e-4a75-8066-a0384a394d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112173428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47d448e4-3334-406b-8c65-d53bc201603f,host='devstack@QuobyteHD#QuobyteHD',id=1fc8b61b-b646-42c8-8354-6432db84aae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:03Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6b19dd7-0196-426f-821f-eb8d9811bc99),volume_type_id=b6b19dd7-0196-426f-821f-eb8d9811bc99)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f7557d-956b-47aa-b1e1-6c87dca505c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f7557d-956b-47aa-b1e1-6c87dca505c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872a2983-fc3e-41bb-a7cb-abe0198f8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872a2983-fc3e-41bb-a7cb-abe0198f8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc8b61b-b646-42c8-8354-6432db84aae0', 'volume_name': 'volume-1fc8b61b-b646-42c8-8354-6432db84aae0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d03d2b1-5a8a-4a9f-96e3-30137eb7395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d03d2b1-5a8a-4a9f-96e3-30137eb7395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99d96c9-08d3-44d8-ba1e-f988fbb45bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Volume 1fc8b61b-b646-42c8-8354-6432db84aae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc8b61b-b646-42c8-8354-6432db84aae0', 'volume_size': 1} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47d448e4-3334-406b-8c65-d53bc201603f,created_at=2026-11-03T06:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112173428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47d448e4-3334-406b-8c65-d53bc201603f,host='devstack@QuobyteHD#QuobyteHD',id=1fc8b61b-b646-42c8-8354-6432db84aae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e0e1bbf1e427f9e88dc518004ca06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:03Z,use_quota=True,user_id='21474fb0d12549bb9124ce878f113f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6b19dd7-0196-426f-821f-eb8d9811bc99),volume_type_id=b6b19dd7-0196-426f-821f-eb8d9811bc99)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Creating volume 1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:03 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 1073741824 Nov 03 07:38:03 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:04 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 1073741824" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:04 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 Nov 03 07:38:04 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:05 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0" returned: 0 in 0.540s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99d96c9-08d3-44d8-ba1e-f988fbb45bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc8b61b-b646-42c8-8354-6432db84aae0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcefff1d-5d35-4ecb-8960-052fca712c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Volume volume-1fc8b61b-b646-42c8-8354-6432db84aae0 (1fc8b61b-b646-42c8-8354-6432db84aae0): created successfully Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcefff1d-5d35-4ecb-8960-052fca712c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Flow 'volume_create_manager' (4378d16c-f9fd-443a-9aa9-8ba68aa5dd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f5db48ec-cb9e-44a4-9d53-1c225480f84c tempest-GroupSnapshotsTest-1288198965 None] Created volume successfully. Nov 03 07:38:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] GroupSnapshot d340523c-29f3-4e92-976a-2fb147d22ada: creating. Nov 03 07:38:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Group snapshot d340523c-29f3-4e92-976a-2fb147d22ada: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:38:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Creating offline snapshot b6752687-263e-4635-863c-b9f268b31732 of volume 1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:38:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d6646-3847-4403-9124-949e425ed952]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:06 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 Nov 03 07:38:06 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:07 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:07 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 1G Nov 03 07:38:07 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:08 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 1G" returned: 0 in 0.856s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc8b61b-b646-42c8-8354-6432db84aae0 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:08 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc8b61b-b646-42c8-8354-6432db84aae0 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 Nov 03 07:38:08 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:08 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc8b61b-b646-42c8-8354-6432db84aae0 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732" returned: 0 in 0.535s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:08 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:38:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:08 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 Nov 03 07:38:08 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:09 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732" returned: 0 in 0.526s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:09 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info Nov 03 07:38:09 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:09 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:09 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:38:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:09 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info Nov 03 07:38:09 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:10 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.info" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.573s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-38d0dff2-669e-41ec-9e65-aa5b0e6dbbab tempest-GroupSnapshotsTest-1288198965 None] group_snapshot d340523c-29f3-4e92-976a-2fb147d22ada: created successfully Nov 03 07:38:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] group_snapshot d340523c-29f3-4e92-976a-2fb147d22ada: deleting Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] group_snapshot d340523c-29f3-4e92-976a-2fb147d22ada: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-1fc8b61b-b646-42c8-8354-6432db84aae0" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-1fc8b61b-b646-42c8-8354-6432db84aae0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-b6752687-263e-4635-863c-b9f268b31732" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-b6752687-263e-4635-863c-b9f268b31732" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Deleting offline snapshot b6752687-263e-4635-863c-b9f268b31732 of volume 1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] snapshot_file for this snap is: volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf91e4a-34e8-488d-9860-a74b1dab03aa]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:11 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 Nov 03 07:38:11 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Flow 'volume_create_manager' (b72accb8-9682-40d5-83fe-184ea79210e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adbd73d-a6f8-4363-ba88-2c305233d448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adbd73d-a6f8-4363-ba88-2c305233d448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1237738227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7134502a-0236-4fb4-b592-6a3b31f9ed2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce34d9cda6d4bb0a117f7522e7dd67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:12Z,use_quota=True,user_id='bf6ad6fb73c0480db62755f16ba2f2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3871a3f3-149c-4121-94a3-df625e4b1c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3871a3f3-149c-4121-94a3-df625e4b1c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8607d0c8-8029-472a-b174-90d4d54c84cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8607d0c8-8029-472a-b174-90d4d54c84cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7134502a-0236-4fb4-b592-6a3b31f9ed2b', 'volume_name': 'volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90dcebd6-7cb3-461e-8b5d-5b281c6bcc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90dcebd6-7cb3-461e-8b5d-5b281c6bcc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe6083e-3063-4e88-a7fe-fb7e8d772031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Volume 7134502a-0236-4fb4-b592-6a3b31f9ed2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b', 'volume_size': 1} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1237738227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7134502a-0236-4fb4-b592-6a3b31f9ed2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce34d9cda6d4bb0a117f7522e7dd67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:12Z,use_quota=True,user_id='bf6ad6fb73c0480db62755f16ba2f2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Creating volume 7134502a-0236-4fb4-b592-6a3b31f9ed2b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:11 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b 1073741824 Nov 03 07:38:11 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:12 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732" returned: 0 in 0.598s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc8b61b-b646-42c8-8354-6432db84aae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[908db777-a949-4491-bb1e-2550aa1acc41]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:12 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 Nov 03 07:38:12 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:12 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b 1073741824" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:12 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b Nov 03 07:38:12 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:12 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0" returned: 0 in 0.692s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:12 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 Nov 03 07:38:12 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:13 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe6083e-3063-4e88-a7fe-fb7e8d772031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c31b46-72e4-48f1-8af0-77a51f1b6052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Volume volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b (7134502a-0236-4fb4-b592-6a3b31f9ed2b): created successfully Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c31b46-72e4-48f1-8af0-77a51f1b6052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Flow 'volume_create_manager' (b72accb8-9682-40d5-83fe-184ea79210e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d4f0d4e5-7b45-447e-8072-d6830665b5ba tempest-AttachVolumeTestJSON-1674610177 None] Created volume successfully. Nov 03 07:38:13 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732" returned: 0 in 0.480s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:13 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732 Nov 03 07:38:13 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:13 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0.b6752687-263e-4635-863c-b9f268b31732" returned: 0 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-b6752687-263e-4635-863c-b9f268b31732" released by "_delete_snapshot" :: held 2.305s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-1fc8b61b-b646-42c8-8354-6432db84aae0" released by "delete_snapshot" :: held 2.351s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:13 devstack cinder-volume[86916]: WARNING cinder.quota [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-20785419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-20785419, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:13 devstack cinder-volume[86916]: WARNING cinder.quota [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-20785419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-20785419, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['1fe0b4ac-4b6d-4b6d-b329-748d11af47d3', '39c00242-c2e6-4707-9d9b-442f7f937b19', 'beb2534f-0675-4c23-a425-f5bfecab5303', '9fd61e38-abf2-4a28-a3e6-28b3ae48edef'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d9d14de-c1bd-4ffe-94b2-984a7974639c tempest-GroupSnapshotsTest-1288198965 None] group_snapshot d340523c-29f3-4e92-976a-2fb147d22ada: deleted successfully Nov 03 07:38:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f006b965-4dce-41a6-942b-f1ccbb4bfb2c req-df6e75b3-e7b7-4f5b-9de4-07d2ea69a610 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f006b965-4dce-41a6-942b-f1ccbb4bfb2c req-df6e75b3-e7b7-4f5b-9de4-07d2ea69a610 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f006b965-4dce-41a6-942b-f1ccbb4bfb2c req-df6e75b3-e7b7-4f5b-9de4-07d2ea69a610 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f006b965-4dce-41a6-942b-f1ccbb4bfb2c req-df6e75b3-e7b7-4f5b-9de4-07d2ea69a610 tempest-AttachVolumeTestJSON-1674610177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92e3c8e1-f775-44e0-9662-1daa82d57170', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:38:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f006b965-4dce-41a6-942b-f1ccbb4bfb2c req-df6e75b3-e7b7-4f5b-9de4-07d2ea69a610 tempest-AttachVolumeTestJSON-1674610177 None] attachment_update completed successfully. Nov 03 07:38:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "cinder-quobyte-1fc8b61b-b646-42c8-8354-6432db84aae0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-1fc8b61b-b646-42c8-8354-6432db84aae0" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be7cc64-fd7f-4fa9-a695-fef03207bfc7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:15 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 Nov 03 07:38:15 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:16 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:16 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0 Nov 03 07:38:16 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:16 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1fc8b61b-b646-42c8-8354-6432db84aae0" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Lock "cinder-quobyte-1fc8b61b-b646-42c8-8354-6432db84aae0" released by "delete_volume" :: held 1.124s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['88dfa704-43fa-4d6f-98ca-5bb7ba253ed7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:16 devstack cinder-volume[86916]: WARNING cinder.quota [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-20785419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-20785419, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Created reservations ['8a0f6280-bb47-4e82-8dc0-6427012d5a8e', '44fd725b-aa9e-40ca-b906-89a6d426c526', '87d509f4-54f1-4e6f-a2ee-959c983b408e', '2163e967-c9e0-4467-9c8c-957bfa5b96ea'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:17 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:17 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:17 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.593s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f5fc0ffd-6d82-4b92-8f2b-12cb0ff9603c tempest-GroupSnapshotsTest-1288198965 None] Delete group completed successfully. Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Flow 'volume_create_manager' (b68d18a0-3966-4c7a-8e78-a77b8b51ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4d7886-c85d-484c-acef-5aaf11ec7b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4d7886-c85d-484c-acef-5aaf11ec7b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1001091629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269b95f9-5850-4a90-8b8f-7dca7f7af6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce34d9cda6d4bb0a117f7522e7dd67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:18Z,use_quota=True,user_id='bf6ad6fb73c0480db62755f16ba2f2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72ec857-bb00-4ec3-8cab-67d1b73735bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72ec857-bb00-4ec3-8cab-67d1b73735bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b3179d-87dc-44c6-af5a-eaf7d726adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b3179d-87dc-44c6-af5a-eaf7d726adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269b95f9-5850-4a90-8b8f-7dca7f7af6b6', 'volume_name': 'volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248385d0-8301-4369-92b4-43c57a22073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248385d0-8301-4369-92b4-43c57a22073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1caab47-6ba5-4271-a38b-5a5b98ef7505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Volume 269b95f9-5850-4a90-8b8f-7dca7f7af6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6', 'volume_size': 1} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1001091629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269b95f9-5850-4a90-8b8f-7dca7f7af6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce34d9cda6d4bb0a117f7522e7dd67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:18Z,use_quota=True,user_id='bf6ad6fb73c0480db62755f16ba2f2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Creating volume 269b95f9-5850-4a90-8b8f-7dca7f7af6b6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:18 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 1073741824 Nov 03 07:38:18 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:19 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 1073741824" returned: 0 in 0.740s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:19 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 Nov 03 07:38:19 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:19 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1caab47-6ba5-4271-a38b-5a5b98ef7505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694525d9-82f4-4c3a-b32a-ab5166898ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Volume volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 (269b95f9-5850-4a90-8b8f-7dca7f7af6b6): created successfully Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694525d9-82f4-4c3a-b32a-ab5166898ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Flow 'volume_create_manager' (b68d18a0-3966-4c7a-8e78-a77b8b51ae05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6ddf472b-0518-4c59-b7e0-9e5d2b749177 tempest-AttachVolumeTestJSON-1674610177 None] Created volume successfully. Nov 03 07:38:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-dcb732d0-dfe1-4721-ace5-a49017f5767c req-4c721442-51de-4ad3-a35d-1ef6946462c3 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-dcb732d0-dfe1-4721-ace5-a49017f5767c req-4c721442-51de-4ad3-a35d-1ef6946462c3 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-dcb732d0-dfe1-4721-ace5-a49017f5767c req-4c721442-51de-4ad3-a35d-1ef6946462c3 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-dcb732d0-dfe1-4721-ace5-a49017f5767c req-4c721442-51de-4ad3-a35d-1ef6946462c3 tempest-AttachVolumeTestJSON-1674610177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a58c733b-84b3-424e-8df7-1cbb3c3ead97', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:38:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-dcb732d0-dfe1-4721-ace5-a49017f5767c req-4c721442-51de-4ad3-a35d-1ef6946462c3 tempest-AttachVolumeTestJSON-1674610177 None] attachment_update completed successfully. Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Flow 'volume_create_manager' (756046d0-f736-4887-95f2-52f5406889df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f683bd4-cb9f-41a1-877a-92dd33392382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f683bd4-cb9f-41a1-877a-92dd33392382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1632679198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0716528e-eb95-4f41-ac9d-33d69a98b6ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41a71febbb404adc8975e411f22ea7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:23Z,use_quota=True,user_id='e059d2ce6df74da388fa8ccb6a07807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05087805-7031-4c61-9a85-9aa4d5a5d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05087805-7031-4c61-9a85-9aa4d5a5d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f3a4a7-6b82-482c-9245-7ee6ea3c77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f3a4a7-6b82-482c-9245-7ee6ea3c77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0716528e-eb95-4f41-ac9d-33d69a98b6ec', 'volume_name': 'volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0497ed8-f30d-4cf9-a974-13d31b9135bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0497ed8-f30d-4cf9-a974-13d31b9135bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d25668-6655-4c79-b09c-d1ed75f5b18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Volume 0716528e-eb95-4f41-ac9d-33d69a98b6ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec', 'volume_size': 1} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1632679198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0716528e-eb95-4f41-ac9d-33d69a98b6ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41a71febbb404adc8975e411f22ea7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:23Z,use_quota=True,user_id='e059d2ce6df74da388fa8ccb6a07807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Creating volume 0716528e-eb95-4f41-ac9d-33d69a98b6ec {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:23 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec 1073741824 Nov 03 07:38:23 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:23 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec 1073741824" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:23 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec Nov 03 07:38:23 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:24 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d25668-6655-4c79-b09c-d1ed75f5b18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c78fd16-dc01-424d-bebe-0bf2a1dfd688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Volume volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec (0716528e-eb95-4f41-ac9d-33d69a98b6ec): created successfully Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c78fd16-dc01-424d-bebe-0bf2a1dfd688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Flow 'volume_create_manager' (756046d0-f736-4887-95f2-52f5406889df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93348f13-89b4-4c0c-a3f9-121d3e6f90e1 tempest-VolumesTestJSON-28711997 None] Created volume successfully. Nov 03 07:38:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-d3c298ad-049c-4686-b9a6-ab292863ae33 req-0c4dacb0-728b-4c43-9511-77d9e930e820 tempest-AttachVolumeTestJSON-1674610177 None] Terminate volume connection completed successfully. Nov 03 07:38:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-d3c298ad-049c-4686-b9a6-ab292863ae33 req-0c4dacb0-728b-4c43-9511-77d9e930e820 tempest-AttachVolumeTestJSON-1674610177 None] Deleting attachment 92e3c8e1-f775-44e0-9662-1daa82d57170. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:38:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Flow 'volume_create_manager' (4232a65c-8991-41cb-9273-7f4d426f7928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29e3ab4-e982-4614-b101-640f320644cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29e3ab4-e982-4614-b101-640f320644cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1057007296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e035ab-10b5-4eb9-9c5d-00f03d31e544,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41a71febbb404adc8975e411f22ea7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:26Z,use_quota=True,user_id='e059d2ce6df74da388fa8ccb6a07807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040dac07-4a67-4eca-8f93-4a719c264a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040dac07-4a67-4eca-8f93-4a719c264a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bb0b5d-3cbe-4f5b-8aaf-6e4df217141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bb0b5d-3cbe-4f5b-8aaf-6e4df217141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e035ab-10b5-4eb9-9c5d-00f03d31e544', 'volume_name': 'volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc87c62-caf4-4145-9d74-253e829d112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc87c62-caf4-4145-9d74-253e829d112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9136a0a-536f-4eec-9195-72176694e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Volume d2e035ab-10b5-4eb9-9c5d-00f03d31e544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544', 'volume_size': 1} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1057007296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e035ab-10b5-4eb9-9c5d-00f03d31e544,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41a71febbb404adc8975e411f22ea7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:26Z,use_quota=True,user_id='e059d2ce6df74da388fa8ccb6a07807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Creating volume d2e035ab-10b5-4eb9-9c5d-00f03d31e544 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:26 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:26 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 1073741824 Nov 03 07:38:26 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-5e3cd7de-79f4-4655-b19d-4bdf4f786bda req-2257ce04-458e-48a4-a00b-f660556f8925 tempest-AttachVolumeTestJSON-1674610177 None] Terminate volume connection completed successfully. Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-5e3cd7de-79f4-4655-b19d-4bdf4f786bda req-2257ce04-458e-48a4-a00b-f660556f8925 tempest-AttachVolumeTestJSON-1674610177 None] Deleting attachment a58c733b-84b3-424e-8df7-1cbb3c3ead97. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:38:26 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 1073741824" returned: 0 in 0.592s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:26 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 Nov 03 07:38:26 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:27 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9136a0a-536f-4eec-9195-72176694e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0859285-db54-415e-819a-7e4b4fa8c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Volume volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 (d2e035ab-10b5-4eb9-9c5d-00f03d31e544): created successfully Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0859285-db54-415e-819a-7e4b4fa8c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Flow 'volume_create_manager' (4232a65c-8991-41cb-9273-7f4d426f7928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d4950173-d63f-4321-b820-219690bcf078 tempest-VolumesTestJSON-28711997 None] Created volume successfully. Nov 03 07:38:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d906c4cf-d775-454a-baae-c4f1b3259d59 tempest-GroupsTest-295000197 None] Group tempest-Group1-1207680623: creating Nov 03 07:38:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d906c4cf-d775-454a-baae-c4f1b3259d59 tempest-GroupsTest-295000197 None] Group tempest-Group1-1207680623: created successfully Nov 03 07:38:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d906c4cf-d775-454a-baae-c4f1b3259d59 tempest-GroupsTest-295000197 None] Create group completed successfully. Nov 03 07:38:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-883855b8-fab6-434d-a025-6f6a7d601f6f tempest-GroupsTest-295000197 None] Group tempest-Group2-975009765: creating Nov 03 07:38:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-883855b8-fab6-434d-a025-6f6a7d601f6f tempest-GroupsTest-295000197 None] Group tempest-Group2-975009765: created successfully Nov 03 07:38:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-883855b8-fab6-434d-a025-6f6a7d601f6f tempest-GroupsTest-295000197 None] Create group completed successfully. Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Flow 'volume_create_manager' (5dca5fd2-0d28-4a24-90d0-6230557a3318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa834d2-21a6-4705-b638-e94ebba5b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa834d2-21a6-4705-b638-e94ebba5b690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1421919435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c3b4ba-05a8-4f3b-b2e5-384af7ab2097,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41a71febbb404adc8975e411f22ea7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:29Z,use_quota=True,user_id='e059d2ce6df74da388fa8ccb6a07807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a07fcf-ba24-4008-bc82-4758e8b66644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a07fcf-ba24-4008-bc82-4758e8b66644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b43bfc-b6e6-4ffb-addc-9add8fc05306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b43bfc-b6e6-4ffb-addc-9add8fc05306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c3b4ba-05a8-4f3b-b2e5-384af7ab2097', 'volume_name': 'volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6922f00-3682-4ec2-8410-cbdc1b3d52b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6922f00-3682-4ec2-8410-cbdc1b3d52b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f345f8-a417-4a72-9c53-b960da58bea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Volume 46c3b4ba-05a8-4f3b-b2e5-384af7ab2097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097', 'volume_size': 1} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1421919435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c3b4ba-05a8-4f3b-b2e5-384af7ab2097,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41a71febbb404adc8975e411f22ea7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:29Z,use_quota=True,user_id='e059d2ce6df74da388fa8ccb6a07807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Creating volume 46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:29 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 1073741824 Nov 03 07:38:29 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:30 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 1073741824" returned: 0 in 0.761s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:30 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 Nov 03 07:38:30 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:30 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097" returned: 0 in 0.501s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f345f8-a417-4a72-9c53-b960da58bea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8b5db4-2c5b-4fe0-af41-10b31d0928a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Volume volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 (46c3b4ba-05a8-4f3b-b2e5-384af7ab2097): created successfully Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8b5db4-2c5b-4fe0-af41-10b31d0928a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Flow 'volume_create_manager' (5dca5fd2-0d28-4a24-90d0-6230557a3318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-37d7c419-cfea-41cf-a15f-0102ea3a4e05 tempest-VolumesTestJSON-28711997 None] Created volume successfully. Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Flow 'volume_create_manager' (6cc1e8bc-1c54-4538-9730-972f61d4b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4508b018-0bbf-4ea9-81e0-8214bfec580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4508b018-0bbf-4ea9-81e0-8214bfec580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211438039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=976624af-caa0-4859-9214-04d13ea17b87,host='devstack@QuobyteHD#QuobyteHD',id=457d1dd6-4ce7-4efd-b73e-b67c3a963cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf259ed4fab4b9b9805e1b6eb735996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:31Z,use_quota=True,user_id='c8f419ece20146a49dc92c4dc10c15ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f70ff898-cc24-4024-b812-b7a87c0057da),volume_type_id=f70ff898-cc24-4024-b812-b7a87c0057da)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1d3d33-c117-454a-b4dc-35da56ba212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1d3d33-c117-454a-b4dc-35da56ba212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f023f46d-8c39-4b5c-8c71-6cf41d301ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f023f46d-8c39-4b5c-8c71-6cf41d301ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457d1dd6-4ce7-4efd-b73e-b67c3a963cd8', 'volume_name': 'volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a409970c-7e17-4fd4-8d05-17afa82c83ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a409970c-7e17-4fd4-8d05-17afa82c83ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0313508c-49ee-43ab-b592-303f43febde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Volume 457d1dd6-4ce7-4efd-b73e-b67c3a963cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8', 'volume_size': 1} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=976624af-caa0-4859-9214-04d13ea17b87,created_at=2026-11-03T06:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211438039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=976624af-caa0-4859-9214-04d13ea17b87,host='devstack@QuobyteHD#QuobyteHD',id=457d1dd6-4ce7-4efd-b73e-b67c3a963cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf259ed4fab4b9b9805e1b6eb735996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:31Z,use_quota=True,user_id='c8f419ece20146a49dc92c4dc10c15ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f70ff898-cc24-4024-b812-b7a87c0057da),volume_type_id=f70ff898-cc24-4024-b812-b7a87c0057da)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Creating volume 457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:30 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 1073741824 Nov 03 07:38:30 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:31 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 1073741824" returned: 0 in 0.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:31 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 Nov 03 07:38:31 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:31 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0313508c-49ee-43ab-b592-303f43febde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91476fb1-d0c4-4f88-8ee9-9be34df75389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Volume volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 (457d1dd6-4ce7-4efd-b73e-b67c3a963cd8): created successfully Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91476fb1-d0c4-4f88-8ee9-9be34df75389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Flow 'volume_create_manager' (6cc1e8bc-1c54-4538-9730-972f61d4b76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-de14afcf-aabc-4d70-bbec-ed964558b29a tempest-GroupsTest-295000197 None] Created volume successfully. Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Acquiring lock "cinder-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Lock "cinder-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Acquiring lock "cinder-quobyte-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Lock "cinder-quobyte-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad5653-0acd-4488-9700-61e1d4a29a96]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:32 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 Nov 03 07:38:32 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:32 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097" returned: 0 in 0.488s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "cinder-269b95f9-5850-4a90-8b8f-7dca7f7af6b6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:32 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097 Nov 03 07:38:32 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-269b95f9-5850-4a90-8b8f-7dca7f7af6b6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "cinder-quobyte-269b95f9-5850-4a90-8b8f-7dca7f7af6b6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-quobyte-269b95f9-5850-4a90-8b8f-7dca7f7af6b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c043716-24ac-4890-900c-a74f1873485d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:33 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 Nov 03 07:38:33 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:33 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Lock "cinder-quobyte-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097" released by "delete_volume" :: held 0.895s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Created reservations ['702ca0f0-0893-4089-b465-7df8661f0455', 'da1e2460-623b-4cf2-8c24-1141a0f45b80', 'd70f2a2f-95c9-4dae-910d-9d4c80736ac4', 'd0817699-0960-4c98-85a5-a310b58561de'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:33 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:33 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Acquiring lock "cinder-d2e035ab-10b5-4eb9-9c5d-00f03d31e544-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Lock "cinder-d2e035ab-10b5-4eb9-9c5d-00f03d31e544-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Acquiring lock "cinder-quobyte-d2e035ab-10b5-4eb9-9c5d-00f03d31e544" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:33 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6" returned: 0 in 0.593s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Lock "cinder-quobyte-d2e035ab-10b5-4eb9-9c5d-00f03d31e544" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:33 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6 Nov 03 07:38:33 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a6412-abbc-4c16-bd40-72586c7046ba]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:33 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 Nov 03 07:38:33 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:33 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Deleted volume successfully. Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e312081-ddfd-478c-97d5-9fdf06cd1cfe tempest-VolumesTestJSON-28711997 None] Lock "cinder-46c3b4ba-05a8-4f3b-b2e5-384af7ab2097-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:33 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-269b95f9-5850-4a90-8b8f-7dca7f7af6b6" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-quobyte-269b95f9-5850-4a90-8b8f-7dca7f7af6b6" released by "delete_volume" :: held 0.975s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Created reservations ['07c534e1-b721-4b8a-b3d4-ecc5958b21a1', '5f42fd52-d77d-439d-aaf8-08b59bb98973', '7157f170-1fbf-4692-bc17-8e1e8d091987', '40dbf244-47b0-4502-bfc0-da77c108848a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:34 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:34 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Acquiring lock "cinder-quobyte-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:34 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544" returned: 0 in 0.600s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Lock "cinder-quobyte-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:34 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544 Nov 03 07:38:34 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a96ad-d015-4509-a96d-b69e74e35173]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:34 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Deleted volume successfully. Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31df5b27-60a5-4d36-adda-d19652d57ddf tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-269b95f9-5850-4a90-8b8f-7dca7f7af6b6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:34 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 Nov 03 07:38:34 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:34 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d2e035ab-10b5-4eb9-9c5d-00f03d31e544" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Lock "cinder-quobyte-d2e035ab-10b5-4eb9-9c5d-00f03d31e544" released by "delete_volume" :: held 1.007s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Created reservations ['a314b498-e48a-4f44-90ca-4014b76f03d3', '58c54e2d-e68b-4f24-9cc9-0ef966b5ee23', 'a3c01957-26c9-4acc-8353-9b5ace1edcef', '5f894f02-7d38-4f49-b479-b08c496c1858'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:34 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:34 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:34 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8" returned: 0 in 0.544s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:34 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8 Nov 03 07:38:34 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:35 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Deleted volume successfully. Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d33a6aa0-6bea-499b-b6e9-a91726a25234 tempest-VolumesTestJSON-28711997 None] Lock "cinder-d2e035ab-10b5-4eb9-9c5d-00f03d31e544-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:35 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8" returned: 0 in 0.305s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Lock "cinder-quobyte-457d1dd6-4ce7-4efd-b73e-b67c3a963cd8" released by "delete_volume" :: held 0.924s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "cinder-7134502a-0236-4fb4-b592-6a3b31f9ed2b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-7134502a-0236-4fb4-b592-6a3b31f9ed2b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "cinder-quobyte-7134502a-0236-4fb4-b592-6a3b31f9ed2b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Created reservations ['f5f4827a-8936-49b0-af51-ff59a7060c5c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-quobyte-7134502a-0236-4fb4-b592-6a3b31f9ed2b" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c6d74-c59f-4c45-afa8-25570d6f6c7c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:35 devstack cinder-volume[86916]: WARNING cinder.quota [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-99631048 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-99631048, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:35 devstack cinder-volume[86916]: WARNING cinder.quota [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-99631048 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-99631048, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Created reservations ['6a78e4d1-2d08-4da1-8696-920fc2f9669e', '44c26711-f851-465b-b981-cbb289d1a27a', '558c924e-7d35-4596-8282-7bc1193529d4', 'd9a58104-a6b2-4c00-9ee6-7d45918ea3d1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:35 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b Nov 03 07:38:35 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:35 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:35 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Acquiring lock "cinder-0716528e-eb95-4f41-ac9d-33d69a98b6ec-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Lock "cinder-0716528e-eb95-4f41-ac9d-33d69a98b6ec-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:35 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:35 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b" returned: 0 in 0.466s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-018455b0-72a9-4d24-8eb5-255867b9d0a7 tempest-GroupsTest-295000197 None] Delete group completed successfully. Nov 03 07:38:35 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b Nov 03 07:38:35 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Acquiring lock "cinder-quobyte-0716528e-eb95-4f41-ac9d-33d69a98b6ec" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Lock "cinder-quobyte-0716528e-eb95-4f41-ac9d-33d69a98b6ec" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5cc03-656a-4c3c-8c78-5667fc16c69f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:36 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec Nov 03 07:38:36 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:36 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7134502a-0236-4fb4-b592-6a3b31f9ed2b" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-quobyte-7134502a-0236-4fb4-b592-6a3b31f9ed2b" released by "delete_volume" :: held 0.800s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Created reservations ['44edcb14-2599-4367-915b-19330141e143', '6f23ae2d-671c-4993-871f-081ed4d9d097', '9b860954-b28b-4641-b86a-68886d5b21b8', '135fad8b-e329-4f4b-b0d5-b1949f5014c1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:36 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:36 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:36 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec" returned: 0 in 0.465s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:36 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec Nov 03 07:38:36 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "cinder-736de742-b09c-4bb4-a446-da80ee3c3963-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:36 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Deleted volume successfully. Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-736de742-b09c-4bb4-a446-da80ee3c3963-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4cd6b65-96e3-47d1-9334-ee0dc51a7f0a tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-7134502a-0236-4fb4-b592-6a3b31f9ed2b-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "cinder-quobyte-736de742-b09c-4bb4-a446-da80ee3c3963" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-quobyte-736de742-b09c-4bb4-a446-da80ee3c3963" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17f5d8-d59c-439c-a4d5-3c6fe83618b3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:36 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0716528e-eb95-4f41-ac9d-33d69a98b6ec" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Lock "cinder-quobyte-0716528e-eb95-4f41-ac9d-33d69a98b6ec" released by "delete_volume" :: held 0.898s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Created reservations ['e48483f4-5c1f-4108-83b8-7fcbfd8ae5a3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:36 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 Nov 03 07:38:36 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Created reservations ['5652c941-17d9-463d-a57b-318d8988a3fd', '8641aca0-a1f7-4086-902d-b22e708f0770', '09c9a431-4627-44bf-8878-65bdf6015699', '29cc3cbd-2521-43a0-b175-7a63a8ef95af'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:37 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:37 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:37 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:37 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:37 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:37 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963 Nov 03 07:38:37 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:37 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5545eb41-cdb2-41ad-83fd-8ca2bc6bfb43 tempest-GroupsTest-295000197 None] Delete group completed successfully. Nov 03 07:38:37 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Deleted volume successfully. Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aac2e7f0-12d7-4bf3-af16-d2cbd274634c tempest-VolumesTestJSON-28711997 None] Lock "cinder-0716528e-eb95-4f41-ac9d-33d69a98b6ec-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:37 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-736de742-b09c-4bb4-a446-da80ee3c3963" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-quobyte-736de742-b09c-4bb4-a446-da80ee3c3963" released by "delete_volume" :: held 0.801s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Created reservations ['23c91049-0c9c-4e75-9042-6ca051305008', '2a73a116-5d41-4553-b0c9-bae58336416b', '5e96e56b-202b-43d1-b014-36c587a7c85d', 'aa1f1da4-2fe9-4185-a995-761d31e804c4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:37 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:37 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:37 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Deleted volume successfully. Nov 03 07:38:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9518f45-9c6a-42b1-a220-e684d9917656 tempest-AttachVolumeTestJSON-1674610177 None] Lock "cinder-736de742-b09c-4bb4-a446-da80ee3c3963-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eb47dcb8-89c4-4073-adac-79acd155490a tempest-GroupsTest-295000197 None] Group tempest-GroupsTest-Group-1157421777: creating Nov 03 07:38:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eb47dcb8-89c4-4073-adac-79acd155490a tempest-GroupsTest-295000197 None] Group tempest-GroupsTest-Group-1157421777: created successfully Nov 03 07:38:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eb47dcb8-89c4-4073-adac-79acd155490a tempest-GroupsTest-295000197 None] Create group completed successfully. Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Flow 'volume_create_manager' (4f89e45b-2e38-4573-8915-3c97948f4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cca8012-f135-42c8-8d45-f217be84e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cca8012-f135-42c8-8d45-f217be84e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405005047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4806226-bf74-413d-8b13-1d99a0e8b565,host='devstack@QuobyteHD#QuobyteHD',id=9785b1c7-332d-477a-9ff5-4ec1f9f1d774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf259ed4fab4b9b9805e1b6eb735996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:40Z,use_quota=True,user_id='c8f419ece20146a49dc92c4dc10c15ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f23dda-f01e-410e-bb26-f4ef5c8486f2),volume_type_id=20f23dda-f01e-410e-bb26-f4ef5c8486f2)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ca98e4-7c89-440e-8dd7-0842a0b241d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ca98e4-7c89-440e-8dd7-0842a0b241d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec27aefb-d0c0-4483-aea3-448f60c230f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec27aefb-d0c0-4483-aea3-448f60c230f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9785b1c7-332d-477a-9ff5-4ec1f9f1d774', 'volume_name': 'volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863b6bb6-d816-4799-8ed9-2b68dedb8311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863b6bb6-d816-4799-8ed9-2b68dedb8311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7519ad65-c999-43f6-bb19-2fbd78a0b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Volume 9785b1c7-332d-477a-9ff5-4ec1f9f1d774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774', 'volume_size': 1} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4806226-bf74-413d-8b13-1d99a0e8b565,created_at=2026-11-03T06:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405005047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4806226-bf74-413d-8b13-1d99a0e8b565,host='devstack@QuobyteHD#QuobyteHD',id=9785b1c7-332d-477a-9ff5-4ec1f9f1d774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf259ed4fab4b9b9805e1b6eb735996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:40Z,use_quota=True,user_id='c8f419ece20146a49dc92c4dc10c15ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f23dda-f01e-410e-bb26-f4ef5c8486f2),volume_type_id=20f23dda-f01e-410e-bb26-f4ef5c8486f2)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Creating volume 9785b1c7-332d-477a-9ff5-4ec1f9f1d774 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:40 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 1073741824 Nov 03 07:38:40 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:41 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 1073741824" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:41 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 Nov 03 07:38:41 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:41 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7519ad65-c999-43f6-bb19-2fbd78a0b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dbb752-a1f0-4655-927d-dea027ac2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Volume volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 (9785b1c7-332d-477a-9ff5-4ec1f9f1d774): created successfully Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dbb752-a1f0-4655-927d-dea027ac2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Flow 'volume_create_manager' (4f89e45b-2e38-4573-8915-3c97948f4e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c32b6d95-42be-43f0-a7b2-0a229d0d40a3 tempest-GroupsTest-295000197 None] Created volume successfully. Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Flow 'volume_create_manager' (a3639e73-c596-4c21-835f-da735841aef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394404d5-8dc8-43d1-b169-779b17d97fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394404d5-8dc8-43d1-b169-779b17d97fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384353025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4806226-bf74-413d-8b13-1d99a0e8b565,host='devstack@QuobyteHD#QuobyteHD',id=e8222c97-fead-4cb9-8400-7ed4c8b928a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf259ed4fab4b9b9805e1b6eb735996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:44Z,use_quota=True,user_id='c8f419ece20146a49dc92c4dc10c15ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f23dda-f01e-410e-bb26-f4ef5c8486f2),volume_type_id=20f23dda-f01e-410e-bb26-f4ef5c8486f2)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1836bddf-9cc1-45e3-93bb-77aa637082cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1836bddf-9cc1-45e3-93bb-77aa637082cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e8214e-31a1-41df-8439-8d859eca9835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e8214e-31a1-41df-8439-8d859eca9835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8222c97-fead-4cb9-8400-7ed4c8b928a9', 'volume_name': 'volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4fb0f5-28e8-4c64-b539-031d67cf898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4fb0f5-28e8-4c64-b539-031d67cf898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9039ce-7d43-4ad3-8b26-cf9bb8e4c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Volume e8222c97-fead-4cb9-8400-7ed4c8b928a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9', 'volume_size': 1} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4806226-bf74-413d-8b13-1d99a0e8b565,created_at=2026-11-03T06:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384353025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4806226-bf74-413d-8b13-1d99a0e8b565,host='devstack@QuobyteHD#QuobyteHD',id=e8222c97-fead-4cb9-8400-7ed4c8b928a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf259ed4fab4b9b9805e1b6eb735996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:44Z,use_quota=True,user_id='c8f419ece20146a49dc92c4dc10c15ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f23dda-f01e-410e-bb26-f4ef5c8486f2),volume_type_id=20f23dda-f01e-410e-bb26-f4ef5c8486f2)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Creating volume e8222c97-fead-4cb9-8400-7ed4c8b928a9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:43 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 1073741824 Nov 03 07:38:43 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:44 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 1073741824" returned: 0 in 0.740s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:44 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 Nov 03 07:38:44 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:45 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9039ce-7d43-4ad3-8b26-cf9bb8e4c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b39baf6-f548-4a7d-97f5-56c3c029f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Volume volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 (e8222c97-fead-4cb9-8400-7ed4c8b928a9): created successfully Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b39baf6-f548-4a7d-97f5-56c3c029f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Flow 'volume_create_manager' (a3639e73-c596-4c21-835f-da735841aef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a1d7c023-6228-429f-8d8a-4683fac1dba0 tempest-GroupsTest-295000197 None] Created volume successfully. Nov 03 07:38:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a168870c-e972-4a68-85ce-b344a92c0bab tempest-GroupsTest-295000197 None] Update group completed successfully. Nov 03 07:38:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b3c78f8-d297-4ff1-bac9-7a1eb6310d2b tempest-GroupsTest-295000197 None] Update group completed successfully. Nov 03 07:38:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-792325d8-f784-4b34-a10a-6ab1b98b0c53 req-bc2b156f-594d-4716-92a8-7bc9646cf9ef tempest-TestMinimumBasicScenario-487080026 None] Terminate volume connection completed successfully. Nov 03 07:38:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-792325d8-f784-4b34-a10a-6ab1b98b0c53 req-bc2b156f-594d-4716-92a8-7bc9646cf9ef tempest-TestMinimumBasicScenario-487080026 None] Deleting attachment 544b2412-0651-4eb0-ab76-65fb630ae661. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Acquiring lock "cinder-27ea4781-f3ba-4e3f-a953-f630ee390633-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Lock "cinder-27ea4781-f3ba-4e3f-a953-f630ee390633-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Acquiring lock "cinder-quobyte-27ea4781-f3ba-4e3f-a953-f630ee390633" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Lock "cinder-quobyte-27ea4781-f3ba-4e3f-a953-f630ee390633" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2067c9a-b09f-463f-bc14-47e4bec4b2b1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:49 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 Nov 03 07:38:49 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:49 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633" returned: 0 in 0.565s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:49 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633 Nov 03 07:38:49 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Acquiring lock "cinder-quobyte-9785b1c7-332d-477a-9ff5-4ec1f9f1d774" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Lock "cinder-quobyte-9785b1c7-332d-477a-9ff5-4ec1f9f1d774" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3c9bd-6881-428e-9e3e-0f5efa08da00]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:50 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27ea4781-f3ba-4e3f-a953-f630ee390633" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Lock "cinder-quobyte-27ea4781-f3ba-4e3f-a953-f630ee390633" released by "delete_volume" :: held 1.065s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:50 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 Nov 03 07:38:50 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Created reservations ['50d9fc45-90ad-478d-97e9-895db92e6815', '98e13969-b21a-4c16-a429-9bb2c32d7cae', '4931ed6e-a1fe-41f5-a1ba-c2e50fee5f55', '01017e47-a0e3-41b3-9a41-f80b0b38a222'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:50 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:50 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:50 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774" returned: 0 in 0.598s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:50 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774 Nov 03 07:38:50 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:51 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.357s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Deleted volume successfully. Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ba8c386b-c20c-4a0a-8168-dde41bbb8a92 tempest-TestMinimumBasicScenario-487080026 None] Lock "cinder-27ea4781-f3ba-4e3f-a953-f630ee390633-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:51 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9785b1c7-332d-477a-9ff5-4ec1f9f1d774" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Lock "cinder-quobyte-9785b1c7-332d-477a-9ff5-4ec1f9f1d774" released by "delete_volume" :: held 0.984s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Acquiring lock "cinder-quobyte-e8222c97-fead-4cb9-8400-7ed4c8b928a9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Lock "cinder-quobyte-e8222c97-fead-4cb9-8400-7ed4c8b928a9" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9ff661-8ea1-45f7-bbe1-47f0de243359]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:51 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 Nov 03 07:38:51 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:51 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9" returned: 0 in 0.560s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:51 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9 Nov 03 07:38:51 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Flow 'volume_create_manager' (7d2cf0c9-32e1-41f0-842c-f07c0041dafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ce944a-0c01-4e4b-b543-9d574e11f064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ce944a-0c01-4e4b-b543-9d574e11f064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1012408085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d052e26-f747-4737-9379-4867a27c6f58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63b79e429da6422b92e389cb6bec4914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:52Z,use_quota=True,user_id='41136884934845759521bb8628850514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f30f68-5afe-4ff8-8c05-6069fc8c43a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f30f68-5afe-4ff8-8c05-6069fc8c43a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22fef5e-7188-4735-afe9-6a4a03e370a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22fef5e-7188-4735-afe9-6a4a03e370a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d052e26-f747-4737-9379-4867a27c6f58', 'volume_name': 'volume-7d052e26-f747-4737-9379-4867a27c6f58', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b16846-e3be-4eed-9aed-2bcbbb3597a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b16846-e3be-4eed-9aed-2bcbbb3597a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33df3546-8abd-4259-9227-c35efd5441f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Volume 7d052e26-f747-4737-9379-4867a27c6f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d052e26-f747-4737-9379-4867a27c6f58', 'volume_size': 1} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1012408085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d052e26-f747-4737-9379-4867a27c6f58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63b79e429da6422b92e389cb6bec4914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:52Z,use_quota=True,user_id='41136884934845759521bb8628850514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Creating volume 7d052e26-f747-4737-9379-4867a27c6f58 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e8222c97-fead-4cb9-8400-7ed4c8b928a9" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:52 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 1073741824 Nov 03 07:38:52 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Lock "cinder-quobyte-e8222c97-fead-4cb9-8400-7ed4c8b928a9" released by "delete_volume" :: held 1.332s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Created reservations ['b80751c4-91a3-4ed2-9312-b4c56e6191a5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:52 devstack cinder-volume[86916]: WARNING cinder.quota [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-865688434 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-865688434, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:52 devstack cinder-volume[86916]: WARNING cinder.quota [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-865688434 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-865688434, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:38:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Created reservations ['710b7d7e-8c96-49f1-889a-cf063f1a0497', 'a3d3923d-56ee-4095-80b7-74a4a14d5558', '9296880e-0f70-4a26-831d-887347344afc', '73934cc9-22bd-4075-9eeb-de8b63a8f600'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Created reservations ['7ad64872-d15f-487e-9c05-3868523ae38c', '91b92e40-56ae-4337-9580-8dc1fabddc4f', 'c0d8e783-d18a-4537-a7a0-b7f3a722b408', 'f236c093-443d-496a-9d8f-2f4c99e8bb53'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:53 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:53 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:53 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 1073741824" returned: 0 in 1.061s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:53 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 Nov 03 07:38:53 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:53 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:53 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-36ab72b7-701d-4786-a8d0-947d261b429b tempest-GroupsTest-295000197 None] Delete group completed successfully. Nov 03 07:38:54 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58" returned: 0 in 0.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33df3546-8abd-4259-9227-c35efd5441f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d052e26-f747-4737-9379-4867a27c6f58', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532a1d53-3375-4df5-b8fa-3729e9487109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Volume volume-7d052e26-f747-4737-9379-4867a27c6f58 (7d052e26-f747-4737-9379-4867a27c6f58): created successfully Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532a1d53-3375-4df5-b8fa-3729e9487109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Flow 'volume_create_manager' (7d2cf0c9-32e1-41f0-842c-f07c0041dafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f1fe68fa-906b-4088-aafc-371173e8c54b req-e5bbf207-36f8-4678-9216-7f04400496a4 tempest-VolumesGetTestJSON-1023354971 None] Created volume successfully. Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:54 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:54 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:54 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:38:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Flow 'volume_create_manager' (637c53c3-ba3d-42cf-9b60-28ca7f3e3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7120b0a0-1032-4057-8043-1f36e31e8509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Acquiring lock "cinder-7d052e26-f747-4737-9379-4867a27c6f58-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7120b0a0-1032-4057-8043-1f36e31e8509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1432487068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac25288-e634-40ea-9e30-2beaea8f91d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c7133abced403fb4f282097656ff9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:55Z,use_quota=True,user_id='39749ae6276b4042a74538ce993fd659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c60d04-05fe-4edb-b741-de27e65382a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c60d04-05fe-4edb-b741-de27e65382a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c343f8a8-40f0-4715-92e1-5a437bae6b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c343f8a8-40f0-4715-92e1-5a437bae6b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac25288-e634-40ea-9e30-2beaea8f91d8', 'volume_name': 'volume-9ac25288-e634-40ea-9e30-2beaea8f91d8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9927c00a-79fe-400e-bfed-6325ca23c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9927c00a-79fe-400e-bfed-6325ca23c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a639b1a2-c86f-4aa5-9cb7-dff7fb2c7b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Volume 9ac25288-e634-40ea-9e30-2beaea8f91d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac25288-e634-40ea-9e30-2beaea8f91d8', 'volume_size': 1} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1432487068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac25288-e634-40ea-9e30-2beaea8f91d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c7133abced403fb4f282097656ff9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:55Z,use_quota=True,user_id='39749ae6276b4042a74538ce993fd659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Creating volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Lock "cinder-7d052e26-f747-4737-9379-4867a27c6f58-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:55 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 1073741824 Nov 03 07:38:55 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Acquiring lock "cinder-quobyte-7d052e26-f747-4737-9379-4867a27c6f58" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Lock "cinder-quobyte-7d052e26-f747-4737-9379-4867a27c6f58" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a65bad2-c077-4427-ad79-fce835d93a00]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:55 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 Nov 03 07:38:55 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:56 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 1073741824" returned: 0 in 0.504s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:56 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:56 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58 Nov 03 07:38:56 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 Nov 03 07:38:56 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:56 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:56 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a639b1a2-c86f-4aa5-9cb7-dff7fb2c7b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac25288-e634-40ea-9e30-2beaea8f91d8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:56 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6fbdff-b2b1-4b9d-ae87-d4b4008038b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7d052e26-f747-4737-9379-4867a27c6f58" returned: 0 in 0.424s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Volume volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 (9ac25288-e634-40ea-9e30-2beaea8f91d8): created successfully Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6fbdff-b2b1-4b9d-ae87-d4b4008038b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Flow 'volume_create_manager' (637c53c3-ba3d-42cf-9b60-28ca7f3e3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Lock "cinder-quobyte-7d052e26-f747-4737-9379-4867a27c6f58" released by "delete_volume" :: held 0.953s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bf923fcb-ae5e-4ccd-8e40-fb69c364fd2a tempest-SnapshotsActionsTest-1846544909 None] Created volume successfully. Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.quota [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Created reservations ['ba29e97e-1183-4bf7-a0fb-28dd910e5823', 'fcd90eb8-4b6a-4a45-8c11-614fefc05d7b', '7b29afd2-2571-466c-80ff-18afa3019d1f', '8518f8db-1a35-4e62-b4a7-298b307131e5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:56 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:38:56 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:57 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG cinder.manager [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Deleted volume successfully. Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-b5cb7ff3-d98c-4dbb-830b-9410b4c9cb80 req-b68ba689-bde1-4934-afa4-c89d1bab070a tempest-VolumesGetTestJSON-1023354971 None] Lock "cinder-7d052e26-f747-4737-9379-4867a27c6f58-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Creating offline snapshot bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3c6bc-ca09-4c15-956b-5942b269ed80]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:58 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 Nov 03 07:38:58 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:58 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:58 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 1G Nov 03 07:38:58 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:59 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 1G" returned: 0 in 0.657s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:59 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:38:59 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:59 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.568s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:59 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 is being set with open permissions: ugo+rw Nov 03 07:38:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:59 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:38:59 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:00 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:00 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info Nov 03 07:39:00 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:00 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info is being set with open permissions: ugo+rw Nov 03 07:39:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:00 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info Nov 03 07:39:00 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:00 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.info" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-710ea4df-0e18-41d8-b23c-b3972b7b6907 tempest-SnapshotsActionsTest-1846544909 None] Create snapshot completed successfully Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Creating offline snapshot c073280e-0d52-4157-8922-03414d2ce029 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ab0f2-f101-4cd4-affe-ec87e6984640]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:02 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:02 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:02 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:02 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 1G Nov 03 07:39:02 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:03 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 1G" returned: 0 in 0.813s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:03 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 Nov 03 07:39:03 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=156,cinder:SELECT=144,cinder:DELETE=16,cinder:INSERT=36 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-16ec6dbc-e8e5-4d09-9527-7e97dcb62843 tempest-GroupsV320Test-902622652 None] Group tempest-GroupsV320Test-Group-2109166701: creating Nov 03 07:39:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=142,cinder:INSERT=37,cinder:UPDATE=175,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-16ec6dbc-e8e5-4d09-9527-7e97dcb62843 tempest-GroupsV320Test-902622652 None] Group tempest-GroupsV320Test-Group-2109166701: created successfully Nov 03 07:39:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-16ec6dbc-e8e5-4d09-9527-7e97dcb62843 tempest-GroupsV320Test-902622652 None] Create group completed successfully. Nov 03 07:39:04 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029" returned: 0 in 0.553s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 is being set with open permissions: ugo+rw Nov 03 07:39:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:04 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 Nov 03 07:39:04 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:04 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-caa985b0-2bea-4fb6-9090-412082ccdf29 tempest-SnapshotsActionsTest-1846544909 None] Create snapshot completed successfully Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-c073280e-0d52-4157-8922-03414d2ce029-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-c073280e-0d52-4157-8922-03414d2ce029-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-c073280e-0d52-4157-8922-03414d2ce029" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-c073280e-0d52-4157-8922-03414d2ce029" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Deleting offline snapshot c073280e-0d52-4157-8922-03414d2ce029 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] snapshot_file for this snap is: volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4bb0de-2daf-407d-b98a-f8e588bd7c5f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:05 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 Nov 03 07:39:05 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Created reservations ['06dbf089-5a72-463a-a46b-8dba859533a4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:06 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adb3167-8373-42ff-8589-275399dd3682]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:06 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:39:06 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-10a6c451-3dbd-4300-a588-392f6959ea6e tempest-GroupSnapshotsV319Test-1737761747 None] Group tempest-GroupSnapshotsV319Test-Group-1573776817: creating Nov 03 07:39:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-10a6c451-3dbd-4300-a588-392f6959ea6e tempest-GroupSnapshotsV319Test-1737761747 None] Group tempest-GroupSnapshotsV319Test-Group-1573776817: created successfully Nov 03 07:39:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-10a6c451-3dbd-4300-a588-392f6959ea6e tempest-GroupSnapshotsV319Test-1737761747 None] Create group completed successfully. Nov 03 07:39:06 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:06 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:06 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-01fddcea-77b3-4dd1-9926-105839b2c037 tempest-GroupsV320Test-902622652 None] Delete group completed successfully. Nov 03 07:39:06 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:06 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 Nov 03 07:39:06 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:07 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:07 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029 Nov 03 07:39:07 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:07 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.c073280e-0d52-4157-8922-03414d2ce029" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-c073280e-0d52-4157-8922-03414d2ce029" released by "_delete_snapshot" :: held 2.170s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" released by "delete_snapshot" :: held 2.217s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Created reservations ['ecb54ef7-4a3b-4eff-8557-7dff17db6a1f', 'd3b52487-c9ab-4d36-8b56-8b1559a185f7', '0cfcb8a3-437a-4b4b-861f-0417a2e06f85', '552c8f71-074d-4bc5-90ed-f849f1ace0fb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Delete snapshot completed successfully. Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7aacec13-d0e1-496e-a424-0eac318fea87 tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-c073280e-0d52-4157-8922-03414d2ce029-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Flow 'volume_create_manager' (f63e1e00-6707-4294-b23f-c6c2d45a1a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b7972-249b-4d60-937d-cfc2f5596f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b7972-249b-4d60-937d-cfc2f5596f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729706113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d18c3e56-79de-4302-9b46-ef2552389405,host='devstack@QuobyteHD#QuobyteHD',id=eebf1142-3c7e-4de2-8762-9007ad704972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151b56b4a60b40ae943358bd24cb981c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:08Z,use_quota=True,user_id='266e406b4a2740148d51acd4c089649e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f8de407-af29-48a9-9372-a5ced4f44823),volume_type_id=9f8de407-af29-48a9-9372-a5ced4f44823)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134dc64c-1060-48a9-a93b-c9088eb88e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134dc64c-1060-48a9-a93b-c9088eb88e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927f220f-39e0-4a54-927a-da9056819b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927f220f-39e0-4a54-927a-da9056819b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebf1142-3c7e-4de2-8762-9007ad704972', 'volume_name': 'volume-eebf1142-3c7e-4de2-8762-9007ad704972', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b03f9-1b8c-4f17-9ee1-a6e4c788931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b03f9-1b8c-4f17-9ee1-a6e4c788931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4e888e-6c31-4cc9-a98e-ec3d422b40d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Volume eebf1142-3c7e-4de2-8762-9007ad704972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebf1142-3c7e-4de2-8762-9007ad704972', 'volume_size': 1} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d18c3e56-79de-4302-9b46-ef2552389405,created_at=2026-11-03T06:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729706113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d18c3e56-79de-4302-9b46-ef2552389405,host='devstack@QuobyteHD#QuobyteHD',id=eebf1142-3c7e-4de2-8762-9007ad704972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151b56b4a60b40ae943358bd24cb981c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:08Z,use_quota=True,user_id='266e406b4a2740148d51acd4c089649e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f8de407-af29-48a9-9372-a5ced4f44823),volume_type_id=9f8de407-af29-48a9-9372-a5ced4f44823)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Creating volume eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:39:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:08 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 1073741824 Nov 03 07:39:08 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:09 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 1073741824" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:09 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 Nov 03 07:39:09 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:09 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4e888e-6c31-4cc9-a98e-ec3d422b40d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebf1142-3c7e-4de2-8762-9007ad704972', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1debe4-a07a-472f-aedf-a1d2fc98d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Creating offline snapshot 72304d8f-0c16-47a5-b3bc-24ade89ec98a of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:39:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Volume volume-eebf1142-3c7e-4de2-8762-9007ad704972 (eebf1142-3c7e-4de2-8762-9007ad704972): created successfully Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1debe4-a07a-472f-aedf-a1d2fc98d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Flow 'volume_create_manager' (f63e1e00-6707-4294-b23f-c6c2d45a1a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc343f-60b2-4f73-854e-c6830e2d64a0]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-25cbb017-0869-48c7-89d1-afefb08428f6 tempest-GroupSnapshotsV319Test-1737761747 None] Created volume successfully. Nov 03 07:39:09 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:09 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:10 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:10 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a 1G Nov 03 07:39:10 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:10 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a 1G" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:10 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a Nov 03 07:39:10 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:11 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a" returned: 0 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:11 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a is being set with open permissions: ugo+rw Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:11 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a Nov 03 07:39:11 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] GroupSnapshot b851812f-b5ef-4aff-92d7-1ae201722c93: creating. Nov 03 07:39:11 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Group snapshot b851812f-b5ef-4aff-92d7-1ae201722c93: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Creating offline snapshot f9073559-0a3e-4945-956a-01da5cf0db21 of volume eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:39:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-136fd1b9-207a-4e8f-89f3-bc17a3516733 tempest-SnapshotsActionsTest-1846544909 None] Create snapshot completed successfully Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f8464-4bf4-483b-abb3-acd490595e9b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:11 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 Nov 03 07:39:11 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:12 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972" returned: 0 in 0.538s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:12 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 1G Nov 03 07:39:12 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:12 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 1G" returned: 0 in 0.588s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebf1142-3c7e-4de2-8762-9007ad704972 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:12 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebf1142-3c7e-4de2-8762-9007ad704972 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 Nov 03 07:39:12 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-72304d8f-0c16-47a5-b3bc-24ade89ec98a-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-72304d8f-0c16-47a5-b3bc-24ade89ec98a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-72304d8f-0c16-47a5-b3bc-24ade89ec98a" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-72304d8f-0c16-47a5-b3bc-24ade89ec98a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Deleting offline snapshot 72304d8f-0c16-47a5-b3bc-24ade89ec98a of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] snapshot_file for this snap is: volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd2324-03bb-4a92-afc3-fc253a220f32]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a Nov 03 07:39:13 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebf1142-3c7e-4de2-8762-9007ad704972 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 Nov 03 07:39:13 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a" returned: 0 in 0.502s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d169ab9-e893-4689-bbfb-84fceae98dc5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:13 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info Nov 03 07:39:13 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:13 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:14 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:14 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info Nov 03 07:39:14 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:14 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.494s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:14 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a Nov 03 07:39:14 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:14 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.info" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4bdc10b8-3474-4e0b-8b5d-9e5cbec31a7c tempest-GroupSnapshotsV319Test-1737761747 None] group_snapshot b851812f-b5ef-4aff-92d7-1ae201722c93: created successfully Nov 03 07:39:14 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a" returned: 0 in 0.591s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:14 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a Nov 03 07:39:14 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:15 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.72304d8f-0c16-47a5-b3bc-24ade89ec98a" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-72304d8f-0c16-47a5-b3bc-24ade89ec98a" released by "_delete_snapshot" :: held 2.155s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" released by "delete_snapshot" :: held 2.202s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Created reservations ['74056fa5-7f37-4e33-83e1-ee9aa449b195', 'e171719f-e652-449b-baba-bf89d2844723', 'c435c4f4-5749-45e2-bb71-6efca58cff86', '1ce7f47f-a472-4d89-a6c5-c59793b51ba1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Delete snapshot completed successfully. Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09fe5cb0-a668-4d34-8b58-aed3f3b5960c tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-72304d8f-0c16-47a5-b3bc-24ade89ec98a-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] group_snapshot b851812f-b5ef-4aff-92d7-1ae201722c93: deleting Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] group_snapshot b851812f-b5ef-4aff-92d7-1ae201722c93: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "cinder-quobyte-eebf1142-3c7e-4de2-8762-9007ad704972" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "cinder-quobyte-eebf1142-3c7e-4de2-8762-9007ad704972" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "cinder-quobyte-f9073559-0a3e-4945-956a-01da5cf0db21" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "cinder-quobyte-f9073559-0a3e-4945-956a-01da5cf0db21" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Deleting offline snapshot f9073559-0a3e-4945-956a-01da5cf0db21 of volume eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] snapshot_file for this snap is: volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0fed4-c3e3-43e6-9cfa-7dd234b3f2e3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:16 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 Nov 03 07:39:16 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:16 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Creating offline snapshot 62a09aaa-fcfc-40e8-b463-915632112860 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21" returned: 0 in 0.873s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eebf1142-3c7e-4de2-8762-9007ad704972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debd13b-e715-4627-9f51-16f12c655458]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb128ad-c798-4f74-bafc-7e05739312a0]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:17 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:17 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:17 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 Nov 03 07:39:17 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:17 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972" returned: 0 in 0.471s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:17 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 Nov 03 07:39:17 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:17 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.557s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:17 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 1G Nov 03 07:39:17 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:17 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21" returned: 0 in 0.536s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:17 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21 Nov 03 07:39:17 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:18 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 1G" returned: 0 in 0.724s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:18 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 Nov 03 07:39:18 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:18 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972.f9073559-0a3e-4945-956a-01da5cf0db21" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "cinder-quobyte-f9073559-0a3e-4945-956a-01da5cf0db21" released by "_delete_snapshot" :: held 2.432s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Lock "cinder-quobyte-eebf1142-3c7e-4de2-8762-9007ad704972" released by "delete_snapshot" :: held 2.461s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:18 devstack cinder-volume[86916]: WARNING cinder.quota [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1428195378 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1428195378, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:18 devstack cinder-volume[86916]: WARNING cinder.quota [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1428195378 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1428195378, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] Created reservations ['3983cfc7-7dcc-42ea-9852-951f1cd1f004', 'f4d19d84-62d4-479a-a061-b8e815fc722e', '41754986-dbac-407e-b3ec-29263822e7fa', '3ae04764-5b8e-4181-b370-fecfb1d3561b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-964091ca-1a4c-4c89-9259-065152d2b1f5 tempest-GroupSnapshotsV319Test-1737761747 None] group_snapshot b851812f-b5ef-4aff-92d7-1ae201722c93: deleted successfully Nov 03 07:39:18 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:18 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 is being set with open permissions: ugo+rw Nov 03 07:39:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:18 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 Nov 03 07:39:18 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:19 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-40701d83-711f-4e17-926f-2990fc70e829 tempest-SnapshotsActionsTest-1846544909 None] Create snapshot completed successfully Nov 03 07:39:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "cinder-quobyte-eebf1142-3c7e-4de2-8762-9007ad704972" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Lock "cinder-quobyte-eebf1142-3c7e-4de2-8762-9007ad704972" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[295dd87f-4035-4c79-8ae6-173d800ee0da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:20 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 Nov 03 07:39:20 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-62a09aaa-fcfc-40e8-b463-915632112860-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-62a09aaa-fcfc-40e8-b463-915632112860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-62a09aaa-fcfc-40e8-b463-915632112860" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-62a09aaa-fcfc-40e8-b463-915632112860" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Deleting offline snapshot 62a09aaa-fcfc-40e8-b463-915632112860 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] snapshot_file for this snap is: volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9f0e73-a514-47dc-b730-c7714a23b17c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:20 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 Nov 03 07:39:20 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:20 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972" returned: 0 in 0.599s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:20 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972 Nov 03 07:39:20 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:20 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[047be9c3-7dba-4bee-b6ee-8caf0e0693b3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:20 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-eebf1142-3c7e-4de2-8762-9007ad704972" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Lock "cinder-quobyte-eebf1142-3c7e-4de2-8762-9007ad704972" released by "delete_volume" :: held 1.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Created reservations ['f43c0d43-e832-472a-ab3e-10a700cb089c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:21 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:21 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:21 devstack cinder-volume[86916]: WARNING cinder.quota [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1428195378 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1428195378, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Created reservations ['260233bf-7f7f-4989-b6b2-a0028cb642af', '6f1e9b74-48eb-4d15-a4a8-39326f35c287', 'cf185f90-079b-4bc6-9c3c-22d6228c9a96', 'ecb5a96d-ab6a-47f1-bcb1-2e0a77353e5d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:21 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:39:21 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:21 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.836s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:21 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e270e4ed-4cae-46e5-ac58-308f75a4506e tempest-GroupSnapshotsV319Test-1737761747 None] Delete group completed successfully. Nov 03 07:39:21 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 Nov 03 07:39:21 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:22 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860" returned: 0 in 0.712s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:22 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860 Nov 03 07:39:22 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:22 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.62a09aaa-fcfc-40e8-b463-915632112860" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-62a09aaa-fcfc-40e8-b463-915632112860" released by "_delete_snapshot" :: held 2.719s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" released by "delete_snapshot" :: held 2.764s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Created reservations ['6a037be9-9761-4a26-880a-0d009c0ef023', 'd90c6fa0-ee8a-4d21-a597-36fbd275942b', '18578f4b-8960-463c-8e9a-2fa1e544409a', '3cec951c-2025-4567-b69a-9087f96657fe'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Delete snapshot completed successfully. Nov 03 07:39:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8e76822-7218-49f1-85d5-18660b0312bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-62a09aaa-fcfc-40e8-b463-915632112860-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Creating offline snapshot 5535587e-cdc5-4885-af54-69b05c05b2d6 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:39:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7c6d65-8328-4879-9a6a-815bd8b35425]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:24 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:24 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:25 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.778s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:25 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 1G Nov 03 07:39:25 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:26 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 1G" returned: 0 in 0.797s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:26 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 Nov 03 07:39:26 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:26 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6" returned: 0 in 0.480s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 is being set with open permissions: ugo+rw Nov 03 07:39:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:26 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 Nov 03 07:39:26 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:26 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6" returned: 0 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4efa6868-f3a6-4509-9cda-d3a9b609d6f6 tempest-SnapshotsActionsTest-1846544909 None] Create snapshot completed successfully Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-5535587e-cdc5-4885-af54-69b05c05b2d6-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-5535587e-cdc5-4885-af54-69b05c05b2d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Acquiring lock "cinder-quobyte-5535587e-cdc5-4885-af54-69b05c05b2d6" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-5535587e-cdc5-4885-af54-69b05c05b2d6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Deleting offline snapshot 5535587e-cdc5-4885-af54-69b05c05b2d6 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] snapshot_file for this snap is: volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25e6b4a-27f9-4e2b-97cb-578a8a7e23d7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:28 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 Nov 03 07:39:28 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:28 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6" returned: 0 in 0.758s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1c5245-6bb7-48e7-bc9d-26feca6c8933]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:29 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:29 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:29 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.618s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:29 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 Nov 03 07:39:29 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:30 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6" returned: 0 in 0.670s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:30 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6 Nov 03 07:39:30 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:30 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.5535587e-cdc5-4885-af54-69b05c05b2d6" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-5535587e-cdc5-4885-af54-69b05c05b2d6" released by "_delete_snapshot" :: held 2.625s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" released by "delete_snapshot" :: held 2.673s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Created reservations ['e5a3e495-38d3-4b70-9733-9fb7cf5abbf7', '8df403ea-4654-4656-bd6b-cc4a3e127d9e', 'c618539f-2e2f-4be4-88fd-03a5a88b0f21', '695fbcfc-00df-4816-aba0-9dac9583a2dc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Delete snapshot completed successfully. Nov 03 07:39:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d5d4001e-fb05-4504-a278-0cb2ad06f5bf tempest-SnapshotsActionsTest-467571957 None] Lock "cinder-5535587e-cdc5-4885-af54-69b05c05b2d6-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "cinder-bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "cinder-quobyte-bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-quobyte-bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Deleting offline snapshot bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 of volume 9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] snapshot_file for this snap is: volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb86ace-5f66-42d5-87f0-29c6d082a004]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:32 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:32 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:33 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.635s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac25288-e634-40ea-9e30-2beaea8f91d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[782bd99b-13e7-4b76-ad32-1abbc52d9173]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:33 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 Nov 03 07:39:33 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:33 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8" returned: 0 in 0.596s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:33 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:33 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:34 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:34 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2 Nov 03 07:39:34 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:34 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8.bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-quobyte-bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2" released by "_delete_snapshot" :: held 2.400s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" released by "delete_snapshot" :: held 2.449s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Created reservations ['fc70c95f-3a9a-4357-bd83-eacc0ff4ee16', '09dd25d3-457a-474a-8d1d-778e0ad8ec9b', '34a5e83e-8793-46d5-9932-0ef3a733d387', '0a4308c8-ce79-4cc8-941b-5477e21a8c86'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Delete snapshot completed successfully. Nov 03 07:39:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd5ed3ad-3b77-402f-b8a9-c9260e86e228 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-bce4e9ab-ef60-4dae-b1a4-29aae35ef3e2-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "cinder-9ac25288-e634-40ea-9e30-2beaea8f91d8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-9ac25288-e634-40ea-9e30-2beaea8f91d8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4776cb0a-0ae7-4ce0-b6e0-5f38901be9d0]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:36 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 Nov 03 07:39:36 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:36 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8" returned: 0 in 0.577s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:36 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8 Nov 03 07:39:36 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:36 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ac25288-e634-40ea-9e30-2beaea8f91d8" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-quobyte-9ac25288-e634-40ea-9e30-2beaea8f91d8" released by "delete_volume" :: held 1.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Created reservations ['030c6116-812e-4dc4-b18e-338579ab4131', 'ff9ed3a1-4e0d-463e-a983-20c544e1019a', 'd772bfd5-adf3-4b18-b0d7-6752b73c9b5f', 'f7b38074-aa9c-488e-a7f7-d136634a82fe'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:37 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:39:37 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:37 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Deleted volume successfully. Nov 03 07:39:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecc6de31-f218-4d0b-b93b-e44eda07c3f6 tempest-SnapshotsActionsTest-1846544909 None] Lock "cinder-9ac25288-e634-40ea-9e30-2beaea8f91d8-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=65,cinder:UPDATE=61,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=70,cinder:SELECT=70,cinder:DELETE=4,cinder:INSERT=19 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Flow 'volume_create_manager' (3dfed744-1c6d-4cfc-bdf2-6ed7a6ec58d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3222aaa-7d0e-496f-803f-ec714422594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3222aaa-7d0e-496f-803f-ec714422594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1540671473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dc89a3-f9c1-44ac-9a36-cb12e3655b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb76e6b50d51427797ff35f10ef85337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:52Z,use_quota=True,user_id='23a67c4603c045f5bd7915e9959ea423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399280f8-4ea3-40ee-8d62-7d3713fe1b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399280f8-4ea3-40ee-8d62-7d3713fe1b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285484f2-7bd8-4b46-bb51-967ae4c932c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285484f2-7bd8-4b46-bb51-967ae4c932c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34dc89a3-f9c1-44ac-9a36-cb12e3655b81', 'volume_name': 'volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2025cae7-d69c-4fd3-9835-076dabb613cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2025cae7-d69c-4fd3-9835-076dabb613cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc5bbac-f2a4-4a8a-ab03-2cd3f44ceeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Volume 34dc89a3-f9c1-44ac-9a36-cb12e3655b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81', 'volume_size': 1} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1540671473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dc89a3-f9c1-44ac-9a36-cb12e3655b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb76e6b50d51427797ff35f10ef85337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:52Z,use_quota=True,user_id='23a67c4603c045f5bd7915e9959ea423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Creating volume 34dc89a3-f9c1-44ac-9a36-cb12e3655b81 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:39:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:51 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 1073741824 Nov 03 07:39:51 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:52 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 1073741824" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:52 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 Nov 03 07:39:52 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:53 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc5bbac-f2a4-4a8a-ab03-2cd3f44ceeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02441a21-22b5-4d7c-a601-43dcfcd5af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Volume volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 (34dc89a3-f9c1-44ac-9a36-cb12e3655b81): created successfully Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02441a21-22b5-4d7c-a601-43dcfcd5af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Flow 'volume_create_manager' (3dfed744-1c6d-4cfc-bdf2-6ed7a6ec58d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a063ebc7-aaf2-4b96-8ab2-6e7f8b98970f tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Created volume successfully. Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:54 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:39:54 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:55 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.635s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:55 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:39:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:39:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:39:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Acquiring lock "cinder-34dc89a3-f9c1-44ac-9a36-cb12e3655b81-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "cinder-34dc89a3-f9c1-44ac-9a36-cb12e3655b81-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Acquiring lock "cinder-quobyte-34dc89a3-f9c1-44ac-9a36-cb12e3655b81" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "cinder-quobyte-34dc89a3-f9c1-44ac-9a36-cb12e3655b81" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7625f2-8faa-4b38-834f-f644317cfb1c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 Nov 03 07:39:56 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:57 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81" returned: 0 in 0.575s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:57 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81 Nov 03 07:39:57 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Flow 'volume_create_manager' (5af75912-de19-4aba-87aa-b0ea83b4f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad5d321-7e44-4329-8151-00bc9d9aee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad5d321-7e44-4329-8151-00bc9d9aee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1806972763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fe7d22-c8c0-4382-bbea-43a5ae1c0069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac3439b0b9948d48c3620c3985bcf7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:57Z,use_quota=True,user_id='2856d3af2e134cedbdcd17e59289781d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbe09157-7827-411f-b32f-53f895244b5f),volume_type_id=bbe09157-7827-411f-b32f-53f895244b5f)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71a4f79-b9f2-4a2c-8d5d-1787ada4174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71a4f79-b9f2-4a2c-8d5d-1787ada4174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59519551-5bc3-4882-98c1-6f556d88a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59519551-5bc3-4882-98c1-6f556d88a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fe7d22-c8c0-4382-bbea-43a5ae1c0069', 'volume_name': 'volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6c0535-876e-4bf5-b9e3-3072ca6800bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6c0535-876e-4bf5-b9e3-3072ca6800bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c23f45-debb-4aca-b594-c67c21483f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Volume a5fe7d22-c8c0-4382-bbea-43a5ae1c0069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069', 'volume_size': 1} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1806972763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fe7d22-c8c0-4382-bbea-43a5ae1c0069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac3439b0b9948d48c3620c3985bcf7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:57Z,use_quota=True,user_id='2856d3af2e134cedbdcd17e59289781d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbe09157-7827-411f-b32f-53f895244b5f),volume_type_id=bbe09157-7827-411f-b32f-53f895244b5f)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Creating volume a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:57 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 1073741824 Nov 03 07:39:57 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:57 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-34dc89a3-f9c1-44ac-9a36-cb12e3655b81" returned: 0 in 0.432s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "cinder-quobyte-34dc89a3-f9c1-44ac-9a36-cb12e3655b81" released by "delete_volume" :: held 1.110s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Created reservations ['64f3e985-c4b8-45e9-a8b9-619bd2c19fac', 'c5907d29-c0c3-4c6f-81be-d20ffb3f511b', 'c4be48df-55b2-4e67-bd83-a2502011668c', 'a90a7124-0245-4eed-af50-86c974c85dc3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:57 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:39:57 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:58 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 1073741824" returned: 0 in 0.781s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:58 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 Nov 03 07:39:58 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:58 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Deleted volume successfully. Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7126313-a02f-4c4b-ae30-65a304b9efc1 tempest-VolumeQuotasNegativeTestJSON-1891067852 None] Lock "cinder-34dc89a3-f9c1-44ac-9a36-cb12e3655b81-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:58 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c23f45-debb-4aca-b594-c67c21483f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74dacec-34d2-44ee-8bd6-262ca5ffb222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Volume volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 (a5fe7d22-c8c0-4382-bbea-43a5ae1c0069): created successfully Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74dacec-34d2-44ee-8bd6-262ca5ffb222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Flow 'volume_create_manager' (5af75912-de19-4aba-87aa-b0ea83b4f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f05f1a73-0c7a-4dee-b421-5f5734491a3c tempest-VolumeTypesAccessTest-767945100 None] Created volume successfully. Nov 03 07:39:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Acquiring lock "cinder-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Lock "cinder-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Acquiring lock "cinder-quobyte-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Lock "cinder-quobyte-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c12473-31e4-4fb8-b560-44f7fec8930f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:59 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 Nov 03 07:39:59 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:00 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069" returned: 0 in 0.830s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:00 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069 Nov 03 07:40:00 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:01 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Lock "cinder-quobyte-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069" released by "delete_volume" :: held 1.625s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:01 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-362697261 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-362697261, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:01 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-362697261 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-362697261, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Created reservations ['49df8cc9-56aa-4512-aec8-b1301ab10917', '6da3a1c3-1463-49ea-b138-62d3d58614b6', '670620ed-8b48-4921-b392-c8d9fbf6123b', '16621270-d58f-4325-bebe-f18b3b4b0434'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:01 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:01 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:02 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.592s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Deleted volume successfully. Nov 03 07:40:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7ce984cf-ffce-412e-b1a7-5fbca9849e25 tempest-VolumeTypesAccessTest-767945100 None] Lock "cinder-a5fe7d22-c8c0-4382-bbea-43a5ae1c0069-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:11 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=13,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:12 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Flow 'volume_create_manager' (576c639d-0117-46b6-b04a-99c81461f1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f382745-6823-4193-bd25-af5679be9ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f382745-6823-4193-bd25-af5679be9ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2041048125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16775b34-bbe0-42a2-aa7b-4f250c1fdca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf186925f9154c8bb9e5acfa23850c57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:14Z,use_quota=True,user_id='40d30c084c2140c1bff0eeb77e6c1cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42303578-756a-41bd-a7ed-b1098d2ee358),volume_type_id=42303578-756a-41bd-a7ed-b1098d2ee358)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831b7765-c82c-469f-868c-d22c599143fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831b7765-c82c-469f-868c-d22c599143fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac108d7-4207-49dd-9b1c-39899195c4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac108d7-4207-49dd-9b1c-39899195c4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16775b34-bbe0-42a2-aa7b-4f250c1fdca8', 'volume_name': 'volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fdd720-9555-4312-b48e-c8510240e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fdd720-9555-4312-b48e-c8510240e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194ce1d4-9fa0-445e-818b-019badcdbd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Volume 16775b34-bbe0-42a2-aa7b-4f250c1fdca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8', 'volume_size': 1} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2041048125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16775b34-bbe0-42a2-aa7b-4f250c1fdca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf186925f9154c8bb9e5acfa23850c57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:14Z,use_quota=True,user_id='40d30c084c2140c1bff0eeb77e6c1cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42303578-756a-41bd-a7ed-b1098d2ee358),volume_type_id=42303578-756a-41bd-a7ed-b1098d2ee358)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Creating volume 16775b34-bbe0-42a2-aa7b-4f250c1fdca8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:40:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:13 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 1073741824 Nov 03 07:40:13 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:14 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 1073741824" returned: 0 in 0.838s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:14 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 Nov 03 07:40:14 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:15 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194ce1d4-9fa0-445e-818b-019badcdbd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9671aee9-a0ea-4cd4-938b-6d9918a505a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Volume volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 (16775b34-bbe0-42a2-aa7b-4f250c1fdca8): created successfully Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9671aee9-a0ea-4cd4-938b-6d9918a505a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Flow 'volume_create_manager' (576c639d-0117-46b6-b04a-99c81461f1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-acdd688f-c6d6-45b7-94ba-6accad4afe60 tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Created volume successfully. Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:16 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:16 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:16 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d0a29701-5d72-43dd-8ad0-051990cf1ede tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Retype volume completed successfully. Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Acquiring lock "cinder-16775b34-bbe0-42a2-aa7b-4f250c1fdca8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "cinder-16775b34-bbe0-42a2-aa7b-4f250c1fdca8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Acquiring lock "cinder-quobyte-16775b34-bbe0-42a2-aa7b-4f250c1fdca8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "cinder-quobyte-16775b34-bbe0-42a2-aa7b-4f250c1fdca8" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e2fd99-2efd-4bf9-8aa3-8982ef8168af]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 Nov 03 07:40:18 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:18 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8" returned: 0 in 0.529s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8 Nov 03 07:40:18 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:19 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-16775b34-bbe0-42a2-aa7b-4f250c1fdca8" returned: 0 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "cinder-quobyte-16775b34-bbe0-42a2-aa7b-4f250c1fdca8" released by "delete_volume" :: held 0.931s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:19 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:19 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Created reservations ['db2c5db5-681f-4fe0-87b4-44c32257e220', 'c05f5756-6aee-4a5d-80bc-d0692e8e4b00', '861de141-2f0a-43b3-9d35-88be5d8edf68', '6e4f1f17-d143-47f3-83dd-12caee9da771'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:19 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:19 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:19 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Deleted volume successfully. Nov 03 07:40:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0476b03-81ac-47f6-b806-33955c95192b tempest-VolumeRetypeWithoutMigrationTest-2091428591 None] Lock "cinder-16775b34-bbe0-42a2-aa7b-4f250c1fdca8-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Flow 'volume_create_manager' (51318edb-ebe8-4cbe-ba27-d52592ca87e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f60b93-3d32-4a8a-9a42-59ae696e4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f60b93-3d32-4a8a-9a42-59ae696e4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-937134357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813ccc20-ec25-47a0-8f14-24795415e2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6895f5ad6a46ac8a33eed906d5e296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:29Z,use_quota=True,user_id='f62a4e6a510c4bc9964fdeb17fe3a5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b368ea-640f-4a8b-a6e2-46c121708b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b368ea-640f-4a8b-a6e2-46c121708b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39044ab8-f2c9-467d-935f-e32d2d07d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39044ab8-f2c9-467d-935f-e32d2d07d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813ccc20-ec25-47a0-8f14-24795415e2cb', 'volume_name': 'volume-813ccc20-ec25-47a0-8f14-24795415e2cb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2eb747-25fc-4d7c-abc3-271ddf588db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2eb747-25fc-4d7c-abc3-271ddf588db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177b1cb2-e0f8-4af8-9bda-9ba73964e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Volume 813ccc20-ec25-47a0-8f14-24795415e2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813ccc20-ec25-47a0-8f14-24795415e2cb', 'volume_size': 1} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-937134357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813ccc20-ec25-47a0-8f14-24795415e2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6895f5ad6a46ac8a33eed906d5e296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:29Z,use_quota=True,user_id='f62a4e6a510c4bc9964fdeb17fe3a5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Creating volume 813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:40:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:29 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb 1073741824 Nov 03 07:40:29 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:30 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb 1073741824" returned: 0 in 0.954s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:30 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb Nov 03 07:40:30 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:30 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177b1cb2-e0f8-4af8-9bda-9ba73964e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813ccc20-ec25-47a0-8f14-24795415e2cb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4936b1b3-26e4-4d70-9cab-17a834163c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Volume volume-813ccc20-ec25-47a0-8f14-24795415e2cb (813ccc20-ec25-47a0-8f14-24795415e2cb): created successfully Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4936b1b3-26e4-4d70-9cab-17a834163c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Flow 'volume_create_manager' (51318edb-ebe8-4cbe-ba27-d52592ca87e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c001cd47-5374-4106-be6b-5ff0bc402314 tempest-SnapshotMetadataTestJSON-1873388069 None] Created volume successfully. Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Flow 'volume_create_manager' (20992fcc-6251-4e62-bc39-4b97e9f510e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b88193b-b576-4483-a70a-2117af9ce15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b88193b-b576-4483-a70a-2117af9ce15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-375162478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1518b1ed3945b0addf077321a5f4c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:31Z,use_quota=True,user_id='16ae3747055a42fa9a69a5177a3f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe55c45-07b8-4dc4-b4a6-3dfaa70fb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe55c45-07b8-4dc4-b4a6-3dfaa70fb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa0aa10-01ae-4e1f-8080-34e4bf7602fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa0aa10-01ae-4e1f-8080-34e4bf7602fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9', 'volume_name': 'volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f341397e-4c10-4f74-8e4d-8434dcfdb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f341397e-4c10-4f74-8e4d-8434dcfdb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f377dc-16f5-47d1-b696-0a97377b4bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Volume 8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9', 'volume_size': 1} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-375162478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1518b1ed3945b0addf077321a5f4c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:31Z,use_quota=True,user_id='16ae3747055a42fa9a69a5177a3f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Creating volume 8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:31 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:31 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 1073741824 Nov 03 07:40:31 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Flow 'volume_create_manager' (343a42d1-eb8c-4a74-ac77-069fab45af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0b57b6-9221-4b64-a0d4-4db9a3773785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0b57b6-9221-4b64-a0d4-4db9a3773785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-599080648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b95ca81-3a35-42a6-b88d-acd2aa5ae643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3548a04dcee4149b01345c5fb3f8804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:31Z,use_quota=True,user_id='b649deee18fb435385e75f9cc2e0d743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fce63c6-829c-4ffd-bfa3-4c2cf3806681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fce63c6-829c-4ffd-bfa3-4c2cf3806681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b71f32f-ba5a-47ac-b511-9903fd02435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b71f32f-ba5a-47ac-b511-9903fd02435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b95ca81-3a35-42a6-b88d-acd2aa5ae643', 'volume_name': 'volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ec3968-2adf-4e04-b4a2-0a0402b6aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ec3968-2adf-4e04-b4a2-0a0402b6aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd71483-5901-49bf-bd32-eefc3b1f5451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Volume 0b95ca81-3a35-42a6-b88d-acd2aa5ae643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643', 'volume_size': 1} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:31 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 1073741824" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:32 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 Nov 03 07:40:32 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:32 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-599080648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b95ca81-3a35-42a6-b88d-acd2aa5ae643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3548a04dcee4149b01345c5fb3f8804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:31Z,use_quota=True,user_id='b649deee18fb435385e75f9cc2e0d743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Creating volume 0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f377dc-16f5-47d1-b696-0a97377b4bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45bc640-9d11-4ea3-b307-a4664e6a9acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:32 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 1073741824 Nov 03 07:40:32 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Volume volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 (8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9): created successfully Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45bc640-9d11-4ea3-b307-a4664e6a9acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Flow 'volume_create_manager' (20992fcc-6251-4e62-bc39-4b97e9f510e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6c37d815-e7ae-46ee-a421-202bd493bf8b tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Created volume successfully. Nov 03 07:40:33 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 1073741824" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:33 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 Nov 03 07:40:33 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:33 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" returned: 0 in 0.315s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.905s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd71483-5901-49bf-bd32-eefc3b1f5451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de379429-76a9-4b5e-994c-484e8f9cc0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Creating offline snapshot d2e9bdc3-161e-4071-8200-0da86b6a9588 of volume 813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:40:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Volume volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 (0b95ca81-3a35-42a6-b88d-acd2aa5ae643): created successfully Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de379429-76a9-4b5e-994c-484e8f9cc0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Flow 'volume_create_manager' (343a42d1-eb8c-4a74-ac77-069fab45af07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de89da4-503b-48d7-bb49-0abfad371b18]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b65c9e27-fb05-4c71-b84a-957f04a170cf tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Created volume successfully. Nov 03 07:40:33 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb Nov 03 07:40:33 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:33 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb" returned: 0 in 0.500s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:34 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 1G Nov 03 07:40:34 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-fcc5026c-c27a-40b7-a75c-6c4ac57db625 req-8f1ff529-3a30-466f-8658-6fe45904c9a6 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:34 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 1G" returned: 0 in 0.676s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813ccc20-ec25-47a0-8f14-24795415e2cb -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:34 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813ccc20-ec25-47a0-8f14-24795415e2cb -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 Nov 03 07:40:34 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:35 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813ccc20-ec25-47a0-8f14-24795415e2cb -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588" returned: 0 in 0.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 is being set with open permissions: ugo+rw Nov 03 07:40:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:35 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 Nov 03 07:40:35 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:35 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:35 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info Nov 03 07:40:35 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:35 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info" returned: 0 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info is being set with open permissions: ugo+rw Nov 03 07:40:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:35 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info Nov 03 07:40:35 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:36 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.info" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.820s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-fcc5026c-c27a-40b7-a75c-6c4ac57db625 req-8f1ff529-3a30-466f-8658-6fe45904c9a6 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.151s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-fcc5026c-c27a-40b7-a75c-6c4ac57db625 req-8f1ff529-3a30-466f-8658-6fe45904c9a6 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.424s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d5c5ca78-6f46-4b89-8224-b21185cae50c tempest-SnapshotMetadataTestJSON-1873388069 None] Create snapshot completed successfully Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-fcc5026c-c27a-40b7-a75c-6c4ac57db625 req-8f1ff529-3a30-466f-8658-6fe45904c9a6 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1d8dfa9-0e2c-4cd8-8aaa-8d1cf2923ebb', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Creating offline snapshot 12e226ea-c4f1-41f7-94d0-2047bfb4aad7 of volume 0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb683c-670f-49b2-89a8-a39c061cfb32]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-fcc5026c-c27a-40b7-a75c-6c4ac57db625 req-8f1ff529-3a30-466f-8658-6fe45904c9a6 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] attachment_update completed successfully. Nov 03 07:40:36 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 Nov 03 07:40:36 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:37 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" returned: 0 in 0.638s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:37 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 1G Nov 03 07:40:37 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:37 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 1G" returned: 0 in 0.936s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:38 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 Nov 03 07:40:38 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:38 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "cinder-d2e9bdc3-161e-4071-8200-0da86b6a9588-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 is being set with open permissions: ugo+rw Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-d2e9bdc3-161e-4071-8200-0da86b6a9588-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "cinder-quobyte-813ccc20-ec25-47a0-8f14-24795415e2cb" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:38 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 Nov 03 07:40:38 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-quobyte-813ccc20-ec25-47a0-8f14-24795415e2cb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "cinder-quobyte-d2e9bdc3-161e-4071-8200-0da86b6a9588" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-quobyte-d2e9bdc3-161e-4071-8200-0da86b6a9588" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Deleting offline snapshot d2e9bdc3-161e-4071-8200-0da86b6a9588 of volume 813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] snapshot_file for this snap is: volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[71081976-24b3-4e33-ab6c-660a4a506624]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:38 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 Nov 03 07:40:38 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:38 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:38 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info Nov 03 07:40:38 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:39 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588" returned: 0 in 0.494s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813ccc20-ec25-47a0-8f14-24795415e2cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e5218-8a0e-417e-85a2-ee724a5c0e32]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:39 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:39 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info is being set with open permissions: ugo+rw Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:39 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info Nov 03 07:40:39 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:39 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb Nov 03 07:40:39 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:39 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.info" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.311s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-073210d6-55c7-4bac-8855-64fb3a8c119d tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Create snapshot completed successfully Nov 03 07:40:39 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb" returned: 0 in 0.588s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:39 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 Nov 03 07:40:39 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:40 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588" returned: 0 in 0.550s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:40 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588 Nov 03 07:40:40 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-0098ab35-58f5-40be-8165-0131f3a1e55a req-96c0642f-e55b-4e00-9a06-d5fd617cf344 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Terminate volume connection completed successfully. Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-0098ab35-58f5-40be-8165-0131f3a1e55a req-96c0642f-e55b-4e00-9a06-d5fd617cf344 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Deleting attachment c1d8dfa9-0e2c-4cd8-8aaa-8d1cf2923ebb. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "cinder-12e226ea-c4f1-41f7-94d0-2047bfb4aad7-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-12e226ea-c4f1-41f7-94d0-2047bfb4aad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "cinder-quobyte-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:40 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-quobyte-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "cinder-quobyte-12e226ea-c4f1-41f7-94d0-2047bfb4aad7" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb.d2e9bdc3-161e-4071-8200-0da86b6a9588" returned: 0 in 0.491s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-quobyte-12e226ea-c4f1-41f7-94d0-2047bfb4aad7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Deleting offline snapshot 12e226ea-c4f1-41f7-94d0-2047bfb4aad7 of volume 0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] snapshot_file for this snap is: volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d50f20-6d8a-4212-802e-a857765b7d7f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-quobyte-d2e9bdc3-161e-4071-8200-0da86b6a9588" released by "_delete_snapshot" :: held 2.333s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-quobyte-813ccc20-ec25-47a0-8f14-24795415e2cb" released by "delete_snapshot" :: held 2.367s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Created reservations ['362c1272-e14d-4faf-9f30-3922e34edc1c', '3fb9aabc-e125-4886-9c68-db1e94a56993', 'b6f7d674-5fa0-49e7-9158-59d534f4f8f6', '95c687a4-4afa-448e-b9af-f1f0345a9a75'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:41 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 Nov 03 07:40:41 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Delete snapshot completed successfully. Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f99380b-35b2-49c4-89a2-d259b83d39cb tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-d2e9bdc3-161e-4071-8200-0da86b6a9588-delete_snapshot" released by "delete_snapshot" :: held 2.621s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Acquiring lock "cinder-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "cinder-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:41 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7" returned: 0 in 0.560s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5843eca-a90f-4363-b3f9-75322e170cbe]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Acquiring lock "cinder-quobyte-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "cinder-quobyte-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[776fd21c-f9e6-4710-9719-e1808dcaaf79]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:41 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 Nov 03 07:40:41 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:41 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 Nov 03 07:40:41 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "cinder-813ccc20-ec25-47a0-8f14-24795415e2cb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-813ccc20-ec25-47a0-8f14-24795415e2cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "cinder-quobyte-813ccc20-ec25-47a0-8f14-24795415e2cb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-quobyte-813ccc20-ec25-47a0-8f14-24795415e2cb" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a87b50e-2bbc-42c8-9ffa-c7c8210c79e1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:42 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 Nov 03 07:40:42 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9" returned: 0 in 0.620s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb Nov 03 07:40:42 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9 Nov 03 07:40:42 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7" returned: 0 in 0.523s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7 Nov 03 07:40:42 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb" returned: 0 in 0.620s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:42 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb Nov 03 07:40:42 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:42 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9" returned: 0 in 0.607s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "cinder-quobyte-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9" released by "delete_volume" :: held 1.323s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Created reservations ['8d5fd638-c00f-4a11-bc54-98c18c845c35', '61e57540-3ac8-49a3-995f-b6b2900fd3ef', '2fcf2743-4e17-403f-aac7-811fbc047bb0', '376cd890-80eb-49fa-9a9c-74dc69023745'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:43 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643.12e226ea-c4f1-41f7-94d0-2047bfb4aad7" returned: 0 in 0.429s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-quobyte-12e226ea-c4f1-41f7-94d0-2047bfb4aad7" released by "_delete_snapshot" :: held 2.370s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-quobyte-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" released by "delete_snapshot" :: held 2.412s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:43 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-813ccc20-ec25-47a0-8f14-24795415e2cb" returned: 0 in 0.505s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:43 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:43 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-quobyte-813ccc20-ec25-47a0-8f14-24795415e2cb" released by "delete_volume" :: held 1.231s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Created reservations ['6d67d44d-5d8b-4642-9863-e20043a0df42', '7b404611-5e65-4b91-88da-49138e41352f', 'e46f6568-689f-4ae1-92b0-8cbcf9aab28a', '417117c2-acaa-40b7-bd2d-77fe0134939e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Created reservations ['03a4ca1a-79a2-44af-819f-c22b85710045', 'fedd00e4-b2f9-4e9f-bff1-f136a8eb9707', '0a676e5b-be8a-4300-bf7b-a674f9816628', '07ef6cc7-1759-4e70-b596-f1e9c4cacb88'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Delete snapshot completed successfully. Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-279f608c-62e8-4688-85b5-4ad2e725f24c tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-12e226ea-c4f1-41f7-94d0-2047bfb4aad7-delete_snapshot" released by "delete_snapshot" :: held 2.731s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:43 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:43 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:43 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.494s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Deleted volume successfully. Nov 03 07:40:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1557157-8a40-4365-b5c8-d4c31d092970 tempest-TestServerVolumeAttachScenarioOldVersion-1914391309 None] Lock "cinder-8b6e7689-0f86-4ac7-ba7c-ee8d43612cc9-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:44 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.492s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Deleted volume successfully. Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c725ff8-4392-4b4d-9cc9-481c2912eef2 tempest-SnapshotMetadataTestJSON-1873388069 None] Lock "cinder-813ccc20-ec25-47a0-8f14-24795415e2cb-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "cinder-0b95ca81-3a35-42a6-b88d-acd2aa5ae643-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-0b95ca81-3a35-42a6-b88d-acd2aa5ae643-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "cinder-quobyte-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-quobyte-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba3569-f2f8-4cc3-9c68-e7c111bc24fd]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:44 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 Nov 03 07:40:44 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:45 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" returned: 0 in 0.691s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:45 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643 Nov 03 07:40:45 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:45 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-quobyte-0b95ca81-3a35-42a6-b88d-acd2aa5ae643" released by "delete_volume" :: held 1.294s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Created reservations ['8362f4c5-d72e-4127-96af-696867e6a42c', 'f00299a0-4793-459a-85c5-29240e21209b', '6db14cf9-8215-4aa8-9270-a0b78b97bd63', '95486956-02bb-4c43-b4d9-4b5e086e618c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:45 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:45 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:46 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Deleted volume successfully. Nov 03 07:40:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00327ca5-5e73-4672-904e-a571e1d8aa96 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214381776 None] Lock "cinder-0b95ca81-3a35-42a6-b88d-acd2aa5ae643-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (d197de84-ffd2-48dd-8e4a-5c6604aa530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d867f41-5a13-4a4a-a119-5888cb2d1be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d867f41-5a13-4a4a-a119-5888cb2d1be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1393608942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96286b42-87ad-415f-a7b0-6c3cff2f9eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:53Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2964d221-9cf3-4ea8-bd2d-71a0150ddcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2964d221-9cf3-4ea8-bd2d-71a0150ddcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8122321-e316-4559-b166-63bae2d670f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8122321-e316-4559-b166-63bae2d670f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96286b42-87ad-415f-a7b0-6c3cff2f9eb8', 'volume_name': 'volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffb6477-fc85-46b1-acc9-527a5379c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffb6477-fc85-46b1-acc9-527a5379c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e292922-25b4-4ca3-be3f-4ab233b09b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Volume 96286b42-87ad-415f-a7b0-6c3cff2f9eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8', 'volume_size': 1} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1393608942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96286b42-87ad-415f-a7b0-6c3cff2f9eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:53Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Creating volume 96286b42-87ad-415f-a7b0-6c3cff2f9eb8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:53 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 1073741824 Nov 03 07:40:53 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:53 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 1073741824" returned: 0 in 0.718s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:54 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 Nov 03 07:40:54 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:54 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" returned: 0 in 0.492s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:54 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:40:54 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e292922-25b4-4ca3-be3f-4ab233b09b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99f9cb8-fff3-4054-b1c0-d0350704d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Volume volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 (96286b42-87ad-415f-a7b0-6c3cff2f9eb8): created successfully Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99f9cb8-fff3-4054-b1c0-d0350704d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (d197de84-ffd2-48dd-8e4a-5c6604aa530a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d0b0249f-9ad1-46dd-828c-803e8f106b65 tempest-VolumesActionsTest-1579767294 None] Created volume successfully. Nov 03 07:40:54 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:40:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97361200-9d33-442b-b0b3-db2ba46c8aaf tempest-VolumesActionsTest-1579767294 None] Acquiring lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97361200-9d33-442b-b0b3-db2ba46c8aaf tempest-VolumesActionsTest-1579767294 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" acquired by "attach_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-97361200-9d33-442b-b0b3-db2ba46c8aaf tempest-VolumesActionsTest-1579767294 None] Attaching volume 96286b42-87ad-415f-a7b0-6c3cff2f9eb8 to instance c7327cc1-4850-4e8f-bd44-8fb1abf02913 at mountpoint /dev/vdb on host None. Nov 03 07:40:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-97361200-9d33-442b-b0b3-db2ba46c8aaf tempest-VolumesActionsTest-1579767294 None] Attach volume completed successfully. Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Flow 'volume_create_manager' (074c51bb-7831-4260-83e0-a556373dadca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cbcc59-9e14-400e-aaae-24a63e0f080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97361200-9d33-442b-b0b3-db2ba46c8aaf tempest-VolumesActionsTest-1579767294 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" released by "attach_volume" :: held 0.493s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cbcc59-9e14-400e-aaae-24a63e0f080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-342556529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c808d8-fc05-4b8a-8b66-d61e0500232e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8deb4333a443c8aad4284d8ee2f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:55Z,use_quota=True,user_id='6c660908b7d94e6985b6e5e5b462c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed7b3e4-cd92-401e-94db-407a9d94d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed7b3e4-cd92-401e-94db-407a9d94d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c2b3cf-df73-4124-a762-4770b3ab6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c2b3cf-df73-4124-a762-4770b3ab6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c808d8-fc05-4b8a-8b66-d61e0500232e', 'volume_name': 'volume-85c808d8-fc05-4b8a-8b66-d61e0500232e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb279bd-2ae7-452d-bc87-71cc6b238d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb279bd-2ae7-452d-bc87-71cc6b238d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f97ec0-5b14-469b-aaf6-f5d7444ee42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Volume 85c808d8-fc05-4b8a-8b66-d61e0500232e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c808d8-fc05-4b8a-8b66-d61e0500232e', 'volume_size': 1} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-342556529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c808d8-fc05-4b8a-8b66-d61e0500232e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8deb4333a443c8aad4284d8ee2f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:55Z,use_quota=True,user_id='6c660908b7d94e6985b6e5e5b462c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Creating volume 85c808d8-fc05-4b8a-8b66-d61e0500232e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:40:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:55 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e 1073741824 Nov 03 07:40:55 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:56 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e 1073741824" returned: 0 in 0.849s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:56 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e Nov 03 07:40:56 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:57 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f97ec0-5b14-469b-aaf6-f5d7444ee42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c808d8-fc05-4b8a-8b66-d61e0500232e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccce912a-607f-4f84-9ca7-66d165b44cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Volume volume-85c808d8-fc05-4b8a-8b66-d61e0500232e (85c808d8-fc05-4b8a-8b66-d61e0500232e): created successfully Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccce912a-607f-4f84-9ca7-66d165b44cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Flow 'volume_create_manager' (074c51bb-7831-4260-83e0-a556373dadca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93adda4a-f50f-4b0a-b53a-9e7d776f93ee tempest-VolumesActionsTest-580505994 None] Terminate volume connection completed successfully. Nov 03 07:40:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6ceba59b-4d2f-4586-8158-386bae2701d2 tempest-VolumesTransfersV355Test-1694964096 None] Created volume successfully. Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93adda4a-f50f-4b0a-b53a-9e7d776f93ee tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93adda4a-f50f-4b0a-b53a-9e7d776f93ee tempest-VolumesActionsTest-580505994 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93adda4a-f50f-4b0a-b53a-9e7d776f93ee tempest-VolumesActionsTest-580505994 None] Detaching volume 96286b42-87ad-415f-a7b0-6c3cff2f9eb8 from instance c7327cc1-4850-4e8f-bd44-8fb1abf02913. Nov 03 07:40:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93adda4a-f50f-4b0a-b53a-9e7d776f93ee tempest-VolumesActionsTest-580505994 None] Detach volume completed successfully. Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93adda4a-f50f-4b0a-b53a-9e7d776f93ee tempest-VolumesActionsTest-580505994 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407f13e7-71fa-4a2e-b0a7-8dbf871bee66 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407f13e7-71fa-4a2e-b0a7-8dbf871bee66 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-407f13e7-71fa-4a2e-b0a7-8dbf871bee66 tempest-VolumesActionsTest-1579767294 None] Volume detach called, but volume not attached. Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-407f13e7-71fa-4a2e-b0a7-8dbf871bee66 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Flow 'volume_create_manager' (7ec4796d-4333-4c62-81cf-71e2d519a74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9776b46c-3c6a-4bca-830e-fc20dccc09a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9776b46c-3c6a-4bca-830e-fc20dccc09a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-84576663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7e54d1-cf22-490f-a12b-2c6880e40f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b6dec909b24c209673ca744339fe87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:58Z,use_quota=True,user_id='e2a2e901c8d243f69b1af46cc38d6107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f60c62-70c1-4739-8e66-1b253249fe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f60c62-70c1-4739-8e66-1b253249fe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3157637a-cf75-454b-968c-479f1110144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "cinder-quobyte-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-quobyte-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2114cb-31aa-45e5-9ab1-fe3a072c9140]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:58 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 Nov 03 07:40:58 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3157637a-cf75-454b-968c-479f1110144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a7e54d1-cf22-490f-a12b-2c6880e40f2c', 'volume_name': 'volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d9e664-8443-49af-8ed4-fbae9c4d5599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d9e664-8443-49af-8ed4-fbae9c4d5599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:59 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0970c6e-9345-4f8b-91ae-dbf96f39629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Volume 5a7e54d1-cf22-490f-a12b-2c6880e40f2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Trying to clone 5a7e54d1-cf22-490f-a12b-2c6880e40f2c from image 4c501e6d-7c58-4118-a8ef-07458ac1339d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:59 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8 Nov 03 07:40:59 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6484e2bd-9f62-427b-a2d2-db992765ca97 tempest-VolumesTransfersV355Test-261798834 None] Transfer volume completed successfully. Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:40:59 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48440fb-b534-46d8-beb6-667eb79ee26a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD Nov 03 07:41:00 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" returned: 0 in 0.997s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-quobyte-96286b42-87ad-415f-a7b0-6c3cff2f9eb8" released by "delete_volume" :: held 1.574s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Created reservations ['4cf0a172-6ae3-4f7e-85b4-eaa0098e1d97', 'ecabbe53-ba21-4d64-8095-db8f5805da48', '5c99c852-9e29-46f6-8ae4-58b8eb9e6b1a', '8520e1f0-fa56-42ff-a641-d1791a7c2bc3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:00 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d is fetched for user e2a2e901c8d243f69b1af46cc38d6107. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[354a7887-15f9-4a15-9b03-dc17f08c7abe]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Acquiring lock "cinder-85c808d8-fc05-4b8a-8b66-d61e0500232e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-85c808d8-fc05-4b8a-8b66-d61e0500232e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:00 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD Nov 03 07:41:00 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Acquiring lock "cinder-quobyte-85c808d8-fc05-4b8a-8b66-d61e0500232e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:00 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.429s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-quobyte-85c808d8-fc05-4b8a-8b66-d61e0500232e" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Deleted volume successfully. Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d29079d-f957-4043-b7f4-1ae59d081517]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b54fd94-5ec2-49a0-8f7d-cff1bdefabf4 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-96286b42-87ad-415f-a7b0-6c3cff2f9eb8-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:01 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e Nov 03 07:41:01 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:01 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-84576663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7e54d1-cf22-490f-a12b-2c6880e40f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b6dec909b24c209673ca744339fe87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:58Z,use_quota=True,user_id='e2a2e901c8d243f69b1af46cc38d6107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Creating volume 5a7e54d1-cf22-490f-a12b-2c6880e40f2c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:01 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c 1073741824 Nov 03 07:41:01 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:01 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e" returned: 0 in 0.843s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e Nov 03 07:41:01 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:02 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c 1073741824" returned: 0 in 0.957s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:02 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c Nov 03 07:41:02 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:02 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-85c808d8-fc05-4b8a-8b66-d61e0500232e" returned: 0 in 0.569s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-quobyte-85c808d8-fc05-4b8a-8b66-d61e0500232e" released by "delete_volume" :: held 1.512s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Created reservations ['079bcce3-7ecd-481a-abe0-4747c30e94c3', 'fb1ae568-f182-461f-829e-480813adfd49', 'b6bfe501-c122-4c62-b08e-73a37f08c006', 'dfe56c52-5809-41bf-86c8-b720c7f3f17e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:02 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Attempting download of 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 5a7e54d1-cf22-490f-a12b-2c6880e40f2c. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:41:02 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:02 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a60397-a038-4c34-8a70-1aaed87b5628]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:02 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b Nov 03 07:41:02 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:03 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Deleted volume successfully. Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04fdffe8-0a7e-43fa-bc3a-22e4e704c94e tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-85c808d8-fc05-4b8a-8b66-d61e0500232e-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:03 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b" returned: 0 in 0.498s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:03 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b Nov 03 07:41:03 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:03 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b" returned: 1 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_nc5u679b' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f178ac-509a-4207-8de1-0d7bfea3abba]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:03 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD Nov 03 07:41:03 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Flow 'volume_create_manager' (55636100-32d5-4ba8-8bc0-a4853982fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770fb740-1033-4c78-821b-978807e28b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770fb740-1033-4c78-821b-978807e28b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-523668700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2604f9b4-55e3-4bfc-ac9e-e4b92479fee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8deb4333a443c8aad4284d8ee2f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:04Z,use_quota=True,user_id='6c660908b7d94e6985b6e5e5b462c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d34293-fb93-481e-a515-31c69d733481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d34293-fb93-481e-a515-31c69d733481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd96e829-bbe9-4454-be31-d3943adc730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd96e829-bbe9-4454-be31-d3943adc730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2604f9b4-55e3-4bfc-ac9e-e4b92479fee5', 'volume_name': 'volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fb91e5-c12e-4bc7-83ee-3037f3a8993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fb91e5-c12e-4bc7-83ee-3037f3a8993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9658504-57b6-46f4-91fa-49da7a340512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Volume 2604f9b4-55e3-4bfc-ac9e-e4b92479fee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5', 'volume_size': 1} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-523668700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2604f9b4-55e3-4bfc-ac9e-e4b92479fee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8deb4333a443c8aad4284d8ee2f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:04Z,use_quota=True,user_id='6c660908b7d94e6985b6e5e5b462c69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Creating volume 2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:04 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 1073741824 Nov 03 07:41:04 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:04 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] 4c501e6d-7c58-4118-a8ef-07458ac1339d was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:04 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c Nov 03 07:41:04 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:04 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 1073741824" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:04 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 Nov 03 07:41:04 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:05 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5" returned: 0 in 0.354s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9658504-57b6-46f4-91fa-49da7a340512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d195700-6562-41e8-96a1-a1fb2462f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Volume volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 (2604f9b4-55e3-4bfc-ac9e-e4b92479fee5): created successfully Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d195700-6562-41e8-96a1-a1fb2462f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Flow 'volume_create_manager' (55636100-32d5-4ba8-8bc0-a4853982fad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d16fd2f1-6b2f-428a-8034-f508a2d3b51e tempest-VolumesTransfersV355Test-1694964096 None] Created volume successfully. Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (192f5461-7576-434e-b7d8-512b9b8771c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a3a74b-e057-4f94-82d2-be053f82e7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a3a74b-e057-4f94-82d2-be053f82e7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1129578847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913bd4d0-9e45-4987-bccd-894116b7d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:06Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f0ff40-30eb-4065-95d6-a87a5b896d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f0ff40-30eb-4065-95d6-a87a5b896d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a00453e-0859-44be-bce7-6f1eb8fe0f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a00453e-0859-44be-bce7-6f1eb8fe0f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '913bd4d0-9e45-4987-bccd-894116b7d5ae', 'volume_name': 'volume-913bd4d0-9e45-4987-bccd-894116b7d5ae', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fdbd1f-c6bf-4566-9e14-ed8085fd96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fdbd1f-c6bf-4566-9e14-ed8085fd96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554e42c1-fbaf-43f3-995b-bf51da516ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Volume 913bd4d0-9e45-4987-bccd-894116b7d5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-913bd4d0-9e45-4987-bccd-894116b7d5ae', 'volume_size': 1} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1129578847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913bd4d0-9e45-4987-bccd-894116b7d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:06Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Creating volume 913bd4d0-9e45-4987-bccd-894116b7d5ae {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Acquiring lock "cinder-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:06 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae 1073741824 Nov 03 07:41:06 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Acquiring lock "cinder-quobyte-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-quobyte-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1b81a-f3ec-4354-b2b7-7bba296f9c60]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:06 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 Nov 03 07:41:06 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" returned: 0 in 2.906s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_ktf8uuvedevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:41:07 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Converted 112.00 MB image at 38.52 MB/s Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c 1G Nov 03 07:41:07 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5 Nov 03 07:41:07 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae 1073741824" returned: 0 in 0.677s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae Nov 03 07:41:07 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5" returned: 0 in 0.329s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-quobyte-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5" released by "delete_volume" :: held 0.841s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:07 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c 1G" returned: 0 in 0.413s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Downloaded image 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 5a7e54d1-cf22-490f-a12b-2c6880e40f2c successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d for user e2a2e901c8d243f69b1af46cc38d6107 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Marking volume 5a7e54d1-cf22-490f-a12b-2c6880e40f2c as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Copying metadata from image 4c501e6d-7c58-4118-a8ef-07458ac1339d to 5a7e54d1-cf22-490f-a12b-2c6880e40f2c. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Creating volume glance metadata for volume 5a7e54d1-cf22-490f-a12b-2c6880e40f2c backed by image 4c501e6d-7c58-4118-a8ef-07458ac1339d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:41:07 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Created reservations ['9508eac6-18d9-4865-bc62-949be5d40fa1', '49569d30-420f-4d42-b408-9e4f8e4ce0fd', 'b85a3a16-6016-421e-8bb1-b366c9e62fae', '14d8f59f-514f-4014-b331-5789b0ea3988'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554e42c1-fbaf-43f3-995b-bf51da516ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913bd4d0-9e45-4987-bccd-894116b7d5ae', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c87be-3b9b-431c-b573-aea0a07f9d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Volume volume-913bd4d0-9e45-4987-bccd-894116b7d5ae (913bd4d0-9e45-4987-bccd-894116b7d5ae): created successfully Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c87be-3b9b-431c-b573-aea0a07f9d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (192f5461-7576-434e-b7d8-512b9b8771c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cad0c013-0c5e-4a46-9611-8857e768b670 tempest-VolumesActionsTest-1579767294 None] Created volume successfully. Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0970c6e-9345-4f8b-91ae-dbf96f39629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d11ab3-424d-4e69-9021-dc813838c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:07 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:07 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Volume volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c (5a7e54d1-cf22-490f-a12b-2c6880e40f2c): created successfully Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d11ab3-424d-4e69-9021-dc813838c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Flow 'volume_create_manager' (7ec4796d-4333-4c62-81cf-71e2d519a74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b0270f0a-a9c3-427e-ac9f-bd7abb624060 tempest-VolumesImageMetadata-134702370 None] Created volume successfully. Nov 03 07:41:08 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Deleted volume successfully. Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f2508cb-03cb-4ffb-bd25-a0dbb7f190cd tempest-VolumesTransfersV355Test-1236927399 None] Lock "cinder-2604f9b4-55e3-4bfc-ac9e-e4b92479fee5-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-913bd4d0-9e45-4987-bccd-894116b7d5ae-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Lock "cinder-913bd4d0-9e45-4987-bccd-894116b7d5ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-quobyte-913bd4d0-9e45-4987-bccd-894116b7d5ae" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-913bd4d0-9e45-4987-bccd-894116b7d5ae" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c4eb8-b1fc-4194-b61f-e531da3b4629]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:08 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae Nov 03 07:41:08 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae" returned: 0 in 0.534s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae Nov 03 07:41:09 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Acquiring lock "cinder-5a7e54d1-cf22-490f-a12b-2c6880e40f2c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Lock "cinder-5a7e54d1-cf22-490f-a12b-2c6880e40f2c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Acquiring lock "cinder-quobyte-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Lock "cinder-quobyte-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522a985-d41e-421b-bf14-f2cab435728d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-913bd4d0-9e45-4987-bccd-894116b7d5ae" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-913bd4d0-9e45-4987-bccd-894116b7d5ae" released by "delete_volume" :: held 1.038s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:09 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c Nov 03 07:41:09 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Created reservations ['73558169-69cb-492c-8068-beb598766b7d', '171b3d0c-76df-4c3a-9013-3b608de53b9d', 'ce6234e0-9bde-4503-9aef-35bf342e5b3e', '7e3ea2fc-9ae5-4758-ada9-b431ca57c981'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:09 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" returned: 0 in 0.612s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:10 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c Nov 03 07:41:10 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Deleted volume successfully. Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b20936c7-d65d-4744-a5aa-98626ff557a5 tempest-VolumesActionsTest-580505994 None] Lock "cinder-913bd4d0-9e45-4987-bccd-894116b7d5ae-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:10 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Lock "cinder-quobyte-5a7e54d1-cf22-490f-a12b-2c6880e40f2c" released by "delete_volume" :: held 0.980s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Created reservations ['a3520bc9-1c8c-4b6d-9942-ffb3b07125ed', '64c02404-69c7-4940-aaeb-72e5540e464d', 'a099a587-ad4c-43e0-8f37-d5ed1f64596a', '58176f77-c747-4f4c-99ef-d57a1929ed0f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:10 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.413s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Deleted volume successfully. Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-250e92ed-edb6-438b-9916-d1115138d50a tempest-VolumesImageMetadata-134702370 None] Lock "cinder-5a7e54d1-cf22-490f-a12b-2c6880e40f2c-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=106,cinder:UPDATE=126,cinder:DELETE=11,cinder:INSERT=38 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (a3821f3b-85ca-47f6-93e0-6f65adeb9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a1329-329d-45de-bb01-eeba235069c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a1329-329d-45de-bb01-eeba235069c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691387918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a16a51-abf8-47fb-987d-7b06f256d3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:12Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6daf58-f828-47cd-ba02-79cbc028a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6daf58-f828-47cd-ba02-79cbc028a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9f7889-9ea8-4a98-9c6d-5c7e1a38520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9f7889-9ea8-4a98-9c6d-5c7e1a38520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a16a51-abf8-47fb-987d-7b06f256d3e8', 'volume_name': 'volume-58a16a51-abf8-47fb-987d-7b06f256d3e8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e84c48-5b9a-4c49-a31c-1a68d1f98c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e84c48-5b9a-4c49-a31c-1a68d1f98c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a8b61e-725c-4439-9fa9-80c633c918b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Volume 58a16a51-abf8-47fb-987d-7b06f256d3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a16a51-abf8-47fb-987d-7b06f256d3e8', 'volume_size': 1} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691387918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a16a51-abf8-47fb-987d-7b06f256d3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:12Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Creating volume 58a16a51-abf8-47fb-987d-7b06f256d3e8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:11 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 1073741824 Nov 03 07:41:11 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:12 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 1073741824" returned: 0 in 0.630s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=119,cinder:UPDATE=125,cinder:INSERT=32,cinder:DELETE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:12 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 Nov 03 07:41:12 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:12 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a8b61e-725c-4439-9fa9-80c633c918b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a16a51-abf8-47fb-987d-7b06f256d3e8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e692089e-e2fc-44eb-996d-a9e107fd9768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Volume volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 (58a16a51-abf8-47fb-987d-7b06f256d3e8): created successfully Nov 03 07:41:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e692089e-e2fc-44eb-996d-a9e107fd9768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (a3821f3b-85ca-47f6-93e0-6f65adeb9478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8e5a6f75-7a43-44fe-8406-17caca6878a2 tempest-VolumesActionsTest-1579767294 None] Created volume successfully. Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-58a16a51-abf8-47fb-987d-7b06f256d3e8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Lock "cinder-58a16a51-abf8-47fb-987d-7b06f256d3e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-quobyte-58a16a51-abf8-47fb-987d-7b06f256d3e8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-58a16a51-abf8-47fb-987d-7b06f256d3e8" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea85a26-29fe-4a88-a65a-1cba91472f7e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 Nov 03 07:41:14 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:14 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8" returned: 0 in 0.561s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8 Nov 03 07:41:14 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:15 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-58a16a51-abf8-47fb-987d-7b06f256d3e8" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-58a16a51-abf8-47fb-987d-7b06f256d3e8" released by "delete_volume" :: held 1.019s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Created reservations ['7e53b2dd-0aa2-4538-b1a8-77e1434fb00e', '06d5dcba-1463-4c1a-b597-f71776a6546c', 'e5184b28-8167-47d5-b423-19aa82d8f3bc', '558ef2f0-01ea-4e56-aec4-87f18e556b96'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:15 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:15 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:15 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Deleted volume successfully. Nov 03 07:41:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5084e5d-27eb-4599-b505-2a7428e493c2 tempest-VolumesActionsTest-580505994 None] Lock "cinder-58a16a51-abf8-47fb-987d-7b06f256d3e8-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (31691443-4726-426e-a724-0c01b328483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70712c89-0dfb-430e-8f3d-edfe2954ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70712c89-0dfb-430e-8f3d-edfe2954ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1194699886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e97dc18-b060-4831-b05f-58c3aaeab7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:17Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b53144-e94e-4925-bd10-820983a161a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b53144-e94e-4925-bd10-820983a161a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a6f2d6-d1af-4fd3-a3b5-b8b8ad06b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a6f2d6-d1af-4fd3-a3b5-b8b8ad06b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e97dc18-b060-4831-b05f-58c3aaeab7da', 'volume_name': 'volume-9e97dc18-b060-4831-b05f-58c3aaeab7da', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2c70b8-f9f1-4131-aa2f-ec863d7e726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2c70b8-f9f1-4131-aa2f-ec863d7e726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aeb92c1-1e28-4ba0-bda8-70cf92f67109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Volume 9e97dc18-b060-4831-b05f-58c3aaeab7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e97dc18-b060-4831-b05f-58c3aaeab7da', 'volume_size': 1} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1194699886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e97dc18-b060-4831-b05f-58c3aaeab7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:17Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Creating volume 9e97dc18-b060-4831-b05f-58c3aaeab7da {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:17 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da 1073741824 Nov 03 07:41:17 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:17 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da 1073741824" returned: 0 in 0.596s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:17 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da Nov 03 07:41:17 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:18 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aeb92c1-1e28-4ba0-bda8-70cf92f67109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e97dc18-b060-4831-b05f-58c3aaeab7da', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5965d938-8c46-43c7-93de-d4e3679a5416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Volume volume-9e97dc18-b060-4831-b05f-58c3aaeab7da (9e97dc18-b060-4831-b05f-58c3aaeab7da): created successfully Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5965d938-8c46-43c7-93de-d4e3679a5416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (31691443-4726-426e-a724-0c01b328483f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (509bd71b-749a-4a2f-8fd5-0ee0b6ecfda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7bfd35-2dfd-4fd4-a0b4-ce228e5327b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2ae1be20-f6be-4df1-a889-bf73c95083c6 tempest-VolumesActionsTest-1579767294 None] Created volume successfully. Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7bfd35-2dfd-4fd4-a0b4-ce228e5327b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1518246229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e060d8a8-baac-4cd2-9eb9-1b508d6f3d22,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:18Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b831e0-ef02-4561-b19b-6a5ecb22354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b831e0-ef02-4561-b19b-6a5ecb22354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5de9b3b-e7bd-44b5-b2a0-72a14e2735d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5de9b3b-e7bd-44b5-b2a0-72a14e2735d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e060d8a8-baac-4cd2-9eb9-1b508d6f3d22', 'volume_name': 'volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd50bb7-171d-41f5-8c17-e2ec626d04a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd50bb7-171d-41f5-8c17-e2ec626d04a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d668ca-d79a-4299-ba76-7176c309484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Volume e060d8a8-baac-4cd2-9eb9-1b508d6f3d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22', 'volume_size': 1} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1518246229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e060d8a8-baac-4cd2-9eb9-1b508d6f3d22,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:18Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Creating volume e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:18 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 1073741824 Nov 03 07:41:18 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:19 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 1073741824" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:19 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 Nov 03 07:41:19 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-9e97dc18-b060-4831-b05f-58c3aaeab7da-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Lock "cinder-9e97dc18-b060-4831-b05f-58c3aaeab7da-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:19 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-quobyte-9e97dc18-b060-4831-b05f-58c3aaeab7da" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d668ca-d79a-4299-ba76-7176c309484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8c2b19-8a6b-4355-a686-84a71952dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-9e97dc18-b060-4831-b05f-58c3aaeab7da" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Volume volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 (e060d8a8-baac-4cd2-9eb9-1b508d6f3d22): created successfully Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8c2b19-8a6b-4355-a686-84a71952dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (509bd71b-749a-4a2f-8fd5-0ee0b6ecfda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cdac5f-73b4-4a9a-97e3-8c45c1a4635a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8f1618c1-c30f-42b1-b788-2f52ed07a7a0 tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:41:19 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da Nov 03 07:41:19 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:20 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da" returned: 0 in 0.606s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:20 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da Nov 03 07:41:20 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:20 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9e97dc18-b060-4831-b05f-58c3aaeab7da" returned: 0 in 0.438s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-9e97dc18-b060-4831-b05f-58c3aaeab7da" released by "delete_volume" :: held 1.117s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Created reservations ['d3fc0666-4b6d-4534-858f-f1550da48a75', '09323d09-7169-4642-aee4-58bb3c179e43', 'aa659c2d-bde5-4026-9863-a86968da20f8', '5b5818a8-5e90-4d62-809f-27d1cc190285'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:21 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:21 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Deleted volume successfully. Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5c69558-7e36-45df-b842-0ce5defaaeb7 tempest-VolumesActionsTest-580505994 None] Lock "cinder-9e97dc18-b060-4831-b05f-58c3aaeab7da-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (9d752bd0-50f2-4f15-b793-7023afff0b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1779ad58-f330-4f99-b778-18f420c68901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1779ad58-f330-4f99-b778-18f420c68901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1433442820',display_name='tempest-VolumesGetTest-Volume-274616585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5a8909-924c-4da4-b2d8-c360e240b87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:22Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6bb290-b424-46c4-bde7-2280205fe81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6bb290-b424-46c4-bde7-2280205fe81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e3bb71-6ed4-4c6d-b407-4fe87f6c00ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e3bb71-6ed4-4c6d-b407-4fe87f6c00ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5a8909-924c-4da4-b2d8-c360e240b87f', 'volume_name': 'volume-da5a8909-924c-4da4-b2d8-c360e240b87f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8356ef-22c4-45ad-bdb3-b2c378dde7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8356ef-22c4-45ad-bdb3-b2c378dde7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0178a9-b583-435b-a52e-4d5daec6d5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Volume da5a8909-924c-4da4-b2d8-c360e240b87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5a8909-924c-4da4-b2d8-c360e240b87f', 'volume_size': 1} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1433442820',display_name='tempest-VolumesGetTest-Volume-274616585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5a8909-924c-4da4-b2d8-c360e240b87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:22Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Creating volume da5a8909-924c-4da4-b2d8-c360e240b87f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f 1073741824 Nov 03 07:41:21 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Flow 'volume_create_manager' (44d55dc3-f551-497b-8c4a-9e89dc9c3be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db820ff6-e69d-4f4b-ab37-2c479c024abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db820ff6-e69d-4f4b-ab37-2c479c024abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1759809925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798e9117-5adb-42d8-9dc3-11b4fb82e8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa37e9d7fe164473bc8a703b16aac9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:22Z,use_quota=True,user_id='ce39d64c658c4e32a53912796ae215bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68abd7a7-25bf-4fc0-a5b8-03e1fb343e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68abd7a7-25bf-4fc0-a5b8-03e1fb343e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96ba1bc-eaf4-44bf-b5fe-dda3f5e67149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96ba1bc-eaf4-44bf-b5fe-dda3f5e67149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798e9117-5adb-42d8-9dc3-11b4fb82e8f2', 'volume_name': 'volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c129a5-480b-4e4a-a8fd-416399121eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c129a5-480b-4e4a-a8fd-416399121eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c643b1-a990-44ed-b9d1-583b677f411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Volume 798e9117-5adb-42d8-9dc3-11b4fb82e8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2', 'volume_size': 1} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:22 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (44e9a70f-95a0-4af9-8886-a8cbb34e0f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd03ecf-2716-4e77-9894-b6181f341ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f 1073741824" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd03ecf-2716-4e77-9894-b6181f341ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700565263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae340f7d-ba0d-4661-a18e-8e2dce12223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:23Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471c3d2f-07b4-41f4-ac1f-b8ed0dbbb93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471c3d2f-07b4-41f4-ac1f-b8ed0dbbb93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdd0cbf-6a17-449d-a948-c920f8c23163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdd0cbf-6a17-449d-a948-c920f8c23163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae340f7d-ba0d-4661-a18e-8e2dce12223e', 'volume_name': 'volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06cf0e8-ccfe-4cae-9216-3d75872512fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06cf0e8-ccfe-4cae-9216-3d75872512fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a98601c-f68a-4ae8-8b31-013acf822667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Volume ae340f7d-ba0d-4661-a18e-8e2dce12223e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e', 'volume_size': 1} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:22 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f Nov 03 07:41:22 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:23 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1759809925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798e9117-5adb-42d8-9dc3-11b4fb82e8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa37e9d7fe164473bc8a703b16aac9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:22Z,use_quota=True,user_id='ce39d64c658c4e32a53912796ae215bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Creating volume 798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0178a9-b583-435b-a52e-4d5daec6d5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5a8909-924c-4da4-b2d8-c360e240b87f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:23 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 1073741824 Nov 03 07:41:23 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f7f7ba-6720-4780-8d55-43f9c41e8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Volume volume-da5a8909-924c-4da4-b2d8-c360e240b87f (da5a8909-924c-4da4-b2d8-c360e240b87f): created successfully Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f7f7ba-6720-4780-8d55-43f9c41e8b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (9d752bd0-50f2-4f15-b793-7023afff0b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d84e3ca3-631b-4177-ac74-731808b396ec tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:41:23 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 1073741824" returned: 0 in 0.656s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:23 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 Nov 03 07:41:23 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-da5a8909-924c-4da4-b2d8-c360e240b87f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Lock "cinder-da5a8909-924c-4da4-b2d8-c360e240b87f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-da5a8909-924c-4da4-b2d8-c360e240b87f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-da5a8909-924c-4da4-b2d8-c360e240b87f" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[583df8d2-4d18-4d9c-b6ca-2f2d08f3696f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:24 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f Nov 03 07:41:24 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700565263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae340f7d-ba0d-4661-a18e-8e2dce12223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:23Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Creating volume ae340f7d-ba0d-4661-a18e-8e2dce12223e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:24 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c643b1-a990-44ed-b9d1-583b677f411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5adaf2-9037-4a20-ab3c-2a31c6f47007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:24 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e 1073741824 Nov 03 07:41:24 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Volume volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 (798e9117-5adb-42d8-9dc3-11b4fb82e8f2): created successfully Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5adaf2-9037-4a20-ab3c-2a31c6f47007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Flow 'volume_create_manager' (44d55dc3-f551-497b-8c4a-9e89dc9c3be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7861094e-f28a-4e3b-8be9-67034834ca91 tempest-VolumesDeleteCascade-1782119066 None] Created volume successfully. Nov 03 07:41:24 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f Nov 03 07:41:24 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:24 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:24 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e 1073741824" returned: 0 in 0.623s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-da5a8909-924c-4da4-b2d8-c360e240b87f" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-da5a8909-924c-4da4-b2d8-c360e240b87f" released by "delete_volume" :: held 0.862s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e Nov 03 07:41:24 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Created reservations ['f1e61330-b61c-413f-ac44-6644d0d52da6', 'b9a135c5-9ab3-4dcb-bf5d-938c20718f49', '31441ed6-19e5-43a8-8f3f-a5aa2fa10a72', 'bd98f81d-b836-4c5a-b7a7-45ffee898380'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:25 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:25 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Lock "cinder-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:25 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a98601c-f68a-4ae8-8b31-013acf822667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac44288a-5531-47f5-81a3-7fb71e8bed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Volume volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e (ae340f7d-ba0d-4661-a18e-8e2dce12223e): created successfully Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac44288a-5531-47f5-81a3-7fb71e8bed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (44e9a70f-95a0-4af9-8886-a8cbb34e0f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40a5a2-6344-4a0f-bcd9-5940b2035c84]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bd696660-7261-433c-9d15-76cae9da49bb tempest-VolumesActionsTest-1579767294 None] Created volume successfully. Nov 03 07:41:25 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48a28cb9-2d3f-4e3f-b7b5-825c3227fd39 tempest-VolumesGetTest-1200539598 None] Lock "cinder-da5a8909-924c-4da4-b2d8-c360e240b87f-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:25 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 Nov 03 07:41:25 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Creating offline snapshot f6e76788-8898-45ee-86f7-3038148312ff of volume 798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026d8c9-c485-4953-ad25-e93e81bfd60d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:25 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:26 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22 Nov 03 07:41:26 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 Nov 03 07:41:26 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-ae340f7d-ba0d-4661-a18e-8e2dce12223e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Lock "cinder-ae340f7d-ba0d-4661-a18e-8e2dce12223e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Acquiring lock "cinder-quobyte-ae340f7d-ba0d-4661-a18e-8e2dce12223e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-ae340f7d-ba0d-4661-a18e-8e2dce12223e" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a88d504-c6f9-46c2-9448-154611da0000]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:26 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22" released by "delete_volume" :: held 0.941s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Created reservations ['dc66b2e4-4ad4-4770-acc6-aa746b6a4650', 'de88e4e4-ffe3-471f-b28d-148c13b15521', 'b48dd805-1fc2-41de-9c69-36f3351a8029', '1c66f030-6307-431a-aa7d-ec2370af2a61'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:26 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:26 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e Nov 03 07:41:26 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" returned: 0 in 0.623s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:26 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:26 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff 1G Nov 03 07:41:26 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:41:27 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e Nov 03 07:41:27 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a00df6d-d9f7-4702-a678-49fa9a0cc235 tempest-VolumesGetTest-1200539598 None] Lock "cinder-e060d8a8-baac-4cd2-9eb9-1b508d6f3d22-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:27 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff 1G" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:27 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ae340f7d-ba0d-4661-a18e-8e2dce12223e" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Lock "cinder-quobyte-ae340f7d-ba0d-4661-a18e-8e2dce12223e" released by "delete_volume" :: held 1.052s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Created reservations ['ba6034ac-5bca-481f-9f05-ea55cf9101c6', '99fa600c-e5a1-4f3a-8f91-d3e653c78307', '6ec7d273-b77d-44d2-bef4-fa11bf2b75dc', '5ec011f5-5e22-412b-a36b-ab66ce365627'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:27 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff is being set with open permissions: ugo+rw Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:27 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:27 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:28 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info Nov 03 07:41:28 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:28 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.571s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Deleted volume successfully. Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (a5e04aea-816d-4ebd-abfb-9aac9c7de0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a53f86-d768-402c-af4d-2632e020d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e6e92d19-af2e-48f4-8ea7-e11791110c12 tempest-VolumesActionsTest-580505994 None] Lock "cinder-ae340f7d-ba0d-4661-a18e-8e2dce12223e-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:28 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a53f86-d768-402c-af4d-2632e020d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1291904478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:28Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc88cb35-0780-4417-8f23-fcace6c1789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc88cb35-0780-4417-8f23-fcace6c1789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbdef3c-8b5f-4fad-805d-591e95777f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbdef3c-8b5f-4fad-805d-591e95777f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'volume_name': 'volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1b7bca-46fc-4d91-bc74-e2d5cede802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1b7bca-46fc-4d91-bc74-e2d5cede802a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4433716e-2ce0-499a-a089-a11a35b6f56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Volume c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'volume_size': 1} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info" returned: 0 in 0.580s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info is being set with open permissions: ugo+rw Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:28 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info Nov 03 07:41:28 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:28 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.info" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1291904478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:28Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Creating volume c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:29 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 1073741824 Nov 03 07:41:29 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f39d12e9-1f60-458f-830c-750911f97c4a tempest-VolumesDeleteCascade-1782119066 None] Create snapshot completed successfully Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (16b778d9-339f-4586-b1f0-189385e0843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d22966-1b53-4cec-886f-7b6721c026b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d22966-1b53-4cec-886f-7b6721c026b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243755600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264d417e-7c0c-412e-a1f0-92390a00d1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:29Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c05be8-1478-4891-b48e-a0668c9bd9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c05be8-1478-4891-b48e-a0668c9bd9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5ec464-9030-4423-9682-4f5034231f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5ec464-9030-4423-9682-4f5034231f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264d417e-7c0c-412e-a1f0-92390a00d1fe', 'volume_name': 'volume-264d417e-7c0c-412e-a1f0-92390a00d1fe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5002d820-5533-48c1-8e0a-45813bc7ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5002d820-5533-48c1-8e0a-45813bc7ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3febe41-cefc-4a9e-ae64-9671720c13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Volume 264d417e-7c0c-412e-a1f0-92390a00d1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264d417e-7c0c-412e-a1f0-92390a00d1fe', 'volume_size': 1} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:29 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 1073741824" returned: 0 in 0.654s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:29 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 Nov 03 07:41:29 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:29 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243755600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264d417e-7c0c-412e-a1f0-92390a00d1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4140e3f7525d43a88d1d34b58cc34b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:29Z,use_quota=True,user_id='d229867f1edd4f269cff7f030144488c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Creating volume 264d417e-7c0c-412e-a1f0-92390a00d1fe {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4433716e-2ce0-499a-a089-a11a35b6f56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe 1073741824 Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22545f72-abe4-4cc7-8745-3f643df81d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Volume volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 (c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7): created successfully Nov 03 07:41:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22545f72-abe4-4cc7-8745-3f643df81d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (a5e04aea-816d-4ebd-abfb-9aac9c7de0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-33677066-1ae0-40ee-9bf4-77213edbbefc tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:30 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe 1073741824" returned: 0 in 0.554s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:30 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe Nov 03 07:41:30 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:30 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.518s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3febe41-cefc-4a9e-ae64-9671720c13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264d417e-7c0c-412e-a1f0-92390a00d1fe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40e6103-5603-4ce0-8372-0b86e164b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Creating offline snapshot 94b892b2-be54-407e-b0b1-7d599a57dd7b of volume 798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Volume volume-264d417e-7c0c-412e-a1f0-92390a00d1fe (264d417e-7c0c-412e-a1f0-92390a00d1fe): created successfully Nov 03 07:41:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40e6103-5603-4ce0-8372-0b86e164b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Flow 'volume_create_manager' (16b778d9-339f-4586-b1f0-189385e0843d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded429b-dbf0-4cd4-bbd7-c0b459deb292]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-220c33ef-0444-4ee4-a6cd-b3f05f2e7dcd tempest-VolumesActionsTest-1579767294 None] Created volume successfully. Nov 03 07:41:31 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:31 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (d5f3ba0a-0ee4-4215-9a0c-6897162a28af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a38dce-d87f-40e3-95ed-ca89cc52b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a38dce-d87f-40e3-95ed-ca89cc52b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1188860049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6045cdf-baee-4063-b387-67d678f21e47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:31Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca1466b-3072-4e06-acd9-eedf46f10c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca1466b-3072-4e06-acd9-eedf46f10c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db7ada7-970e-4c8c-b79b-398aee559fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db7ada7-970e-4c8c-b79b-398aee559fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c6045cdf-baee-4063-b387-67d678f21e47', 'volume_name': 'volume-c6045cdf-baee-4063-b387-67d678f21e47', 'volume_size': 1, 'source_volid': 'c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f1d9e-f948-4a2f-b885-d4f17ad90cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f1d9e-f948-4a2f-b885-d4f17ad90cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5532c6-0daa-40d3-b80e-dd2013ad5893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Volume c6045cdf-baee-4063-b387-67d678f21e47: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c6045cdf-baee-4063-b387-67d678f21e47', 'volume_size': 1, 'source_volid': 'c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'source_volstatus': 'available'} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:31 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.553s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b 1G Nov 03 07:41:31 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b 1G" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b Nov 03 07:41:32 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "cinder-264d417e-7c0c-412e-a1f0-92390a00d1fe-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-264d417e-7c0c-412e-a1f0-92390a00d1fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "cinder-quobyte-264d417e-7c0c-412e-a1f0-92390a00d1fe" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-quobyte-264d417e-7c0c-412e-a1f0-92390a00d1fe" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f6fd0-e036-4f31-9e49-76ccfbf4340c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b is being set with open permissions: ugo+rw Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b Nov 03 07:41:32 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe Nov 03 07:41:32 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.509s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Cloning volume c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 to volume c6045cdf-baee-4063-b387-67d678f21e47 Nov 03 07:41:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-947d968d-e6be-410e-a5f9-aa7fc3782045 tempest-VolumesDeleteCascade-1782119066 None] Create snapshot completed successfully Nov 03 07:41:33 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe" returned: 0 in 0.519s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Creating offline snapshot 694df7e0-9606-4983-b645-f88aee5ae3b1 of volume c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:33 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe Nov 03 07:41:33 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac5f74-7bd1-46ba-a931-16058341da07]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 Nov 03 07:41:33 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:33 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-264d417e-7c0c-412e-a1f0-92390a00d1fe" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-quobyte-264d417e-7c0c-412e-a1f0-92390a00d1fe" released by "delete_volume" :: held 0.943s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Created reservations ['59c388f9-2822-4184-b51a-b915e3d498ce', '8f4dbbe7-aa09-40a3-afee-18690c3e3ede', '2a0ecce2-35a2-45bd-92ea-acb9e764e4cf', '983dea1e-c163-4ac9-b120-f1df5d053cdc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:33 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" returned: 0 in 0.579s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:33 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-798e9117-5adb-42d8-9dc3-11b4fb82e8f2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:33 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 1G Nov 03 07:41:33 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-798e9117-5adb-42d8-9dc3-11b4fb82e8f2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Performing cascade delete. {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-94b892b2-be54-407e-b0b1-7d599a57dd7b-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-94b892b2-be54-407e-b0b1-7d599a57dd7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-94b892b2-be54-407e-b0b1-7d599a57dd7b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-94b892b2-be54-407e-b0b1-7d599a57dd7b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Deleting offline snapshot 94b892b2-be54-407e-b0b1-7d599a57dd7b of volume 798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] snapshot_file for this snap is: volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:34 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3fdc9-f1a4-413d-bd9a-b1682de9ddee]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.400s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Deleted volume successfully. Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d61e3c85-6d27-4802-bcb6-35701cd45e72 tempest-VolumesActionsTest-1579767294 None] Lock "cinder-264d417e-7c0c-412e-a1f0-92390a00d1fe-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:34 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b Nov 03 07:41:34 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:34 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 1G" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 Nov 03 07:41:34 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:34 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b" returned: 0 in 0.608s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9b592-e6d0-483d-8c9a-0e3e37248a64]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 is being set with open permissions: ugo+rw Nov 03 07:41:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 Nov 03 07:41:34 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:34 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:34 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info Nov 03 07:41:35 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b Nov 03 07:41:35 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info is being set with open permissions: ugo+rw Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info Nov 03 07:41:35 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b" returned: 0 in 0.557s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b Nov 03 07:41:35 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:36 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.info" returned: 0 in 0.467s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-c6045cdf-baee-4063-b387-67d678f21e47" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-c6045cdf-baee-4063-b387-67d678f21e47" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] snapshot: 694df7e0-9606-4983-b645-f88aee5ae3b1, volume: c6045cdf-baee-4063-b387-67d678f21e47, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:36 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.94b892b2-be54-407e-b0b1-7d599a57dd7b" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4098a1-0cc7-4c8b-9b1f-ddf10b5174cb]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-94b892b2-be54-407e-b0b1-7d599a57dd7b" released by "_delete_snapshot" :: held 2.349s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" released by "delete_snapshot" :: held 2.398s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Created reservations ['0a621622-d2d6-4ea1-9bfb-a104bd162333', '3ba64508-9d35-41c4-b3e5-c7c5a686fd05', 'd8bf3505-794e-4511-ac0d-2ccd4111885c', '8b15baba-6189-4eb4-8566-2302d9b7fb7e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:36 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 Nov 03 07:41:36 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Delete snapshot completed successfully. Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-94b892b2-be54-407e-b0b1-7d599a57dd7b-delete_snapshot" released by "delete_snapshot" :: held 2.707s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-f6e76788-8898-45ee-86f7-3038148312ff-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-f6e76788-8898-45ee-86f7-3038148312ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-f6e76788-8898-45ee-86f7-3038148312ff" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-f6e76788-8898-45ee-86f7-3038148312ff" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Deleting offline snapshot f6e76788-8898-45ee-86f7-3038148312ff of volume 798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] snapshot_file for this snap is: volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa5fc0c-c00b-4c5c-8339-5d5def3d126b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:36 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:36 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1" returned: 0 in 0.580s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee670c-b82e-4583-ba0b-b7470b968aaf]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:37 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 Nov 03 07:41:37 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:37 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.624s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bbff18-bab5-4d51-bd1d-94cc17e3702f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:37 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" returned: 0 in 0.695s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:41:37 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 Nov 03 07:41:37 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:41:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:37 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 Nov 03 07:41:37 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:38 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.822s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:39 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff Nov 03 07:41:39 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:39 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2.f6e76788-8898-45ee-86f7-3038148312ff" returned: 0 in 0.823s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-f6e76788-8898-45ee-86f7-3038148312ff" released by "_delete_snapshot" :: held 3.150s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" released by "delete_snapshot" :: held 3.192s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Created reservations ['130d6a01-7b4d-4f97-a30e-2d635cb5ce04', '2fcf5a9c-ab80-40a2-8de7-b0cc3755f805', 'ed36629c-eb72-4338-acb1-5f7fa25cffb4', '3f1526b6-8219-4f36-adfe-42b87e3b9a1f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Delete snapshot completed successfully. Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-f6e76788-8898-45ee-86f7-3038148312ff-delete_snapshot" released by "delete_snapshot" :: held 3.545s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Snapshots deleted, issuing volume delete {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86647c-a28c-42d4-a327-20807dc926b8]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:40 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 Nov 03 07:41:40 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:41 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:41 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2 Nov 03 07:41:41 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:41 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" returned: 0 in 0.604s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-798e9117-5adb-42d8-9dc3-11b4fb82e8f2" released by "delete_volume" :: held 1.573s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Created reservations ['1953aa1c-5162-4a13-a446-5a61010e3feb', '489a918c-1d2b-46d0-b4d8-420178fa95f6', '1f541fc0-09b9-46b3-9fb2-a546aefa4680', '9e256693-bd2d-4f56-878b-37b0b9496dff'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:42 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:42 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:42 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.615s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Deleted volume successfully. Nov 03 07:41:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ca2f4d3-7f21-456b-a000-ea47c7ac7381 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-798e9117-5adb-42d8-9dc3-11b4fb82e8f2-delete_volume" released by "delete_volume" :: held 9.021s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Flow 'volume_create_manager' (ab716d70-39d5-4174-9387-de798a2f85bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8da3585-d2ca-4c69-b3bf-566338e68c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8da3585-d2ca-4c69-b3bf-566338e68c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-459219645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa37e9d7fe164473bc8a703b16aac9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:45Z,use_quota=True,user_id='ce39d64c658c4e32a53912796ae215bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02bfdaa-e5cc-42c6-94c0-a7978edf00e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02bfdaa-e5cc-42c6-94c0-a7978edf00e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8e1065-1704-4df6-bed1-25899515f443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8e1065-1704-4df6-bed1-25899515f443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa', 'volume_name': 'volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab38dc8-3740-45fc-8a78-1c7adf494f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab38dc8-3740-45fc-8a78-1c7adf494f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110e9da5-2dd0-478c-97ed-3f44d5603bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Volume 2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa', 'volume_size': 1} Nov 03 07:41:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:47 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47" returned: 0 in 10.002s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:41:47 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Converted 1024.00 MB image at 102.37 MB/s Nov 03 07:41:47 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 is being set with open permissions: ugo+rw Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:47 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 Nov 03 07:41:47 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:47 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-c6045cdf-baee-4063-b387-67d678f21e47" released by "_copy_volume_from_snapshot" :: held 11.729s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-694df7e0-9606-4983-b645-f88aee5ae3b1" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-694df7e0-9606-4983-b645-f88aee5ae3b1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Deleting offline snapshot 694df7e0-9606-4983-b645-f88aee5ae3b1 of volume c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] snapshot_file for this snap is: volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abe5e04-a32d-48ae-aa93-845cf59602f1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 Nov 03 07:41:48 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1" returned: 0 in 0.531s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49b4b0-0ea8-424a-8837-d3d233af679a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 Nov 03 07:41:48 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" returned: 0 in 0.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:49 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 Nov 03 07:41:49 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1" returned: 0 in 0.472s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:49 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1 Nov 03 07:41:49 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:50 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7.694df7e0-9606-4983-b645-f88aee5ae3b1" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-694df7e0-9606-4983-b645-f88aee5ae3b1" released by "_delete_snapshot" :: held 2.288s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.333s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.429s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-459219645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa37e9d7fe164473bc8a703b16aac9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:45Z,use_quota=True,user_id='ce39d64c658c4e32a53912796ae215bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Creating volume 2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:50 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa 1073741824 Nov 03 07:41:50 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5532c6-0daa-40d3-b80e-dd2013ad5893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6045cdf-baee-4063-b387-67d678f21e47', 'volume_size': 1, 'source_volid': 'c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5273ca-e65c-47bc-aa94-ca81047a07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Volume volume-c6045cdf-baee-4063-b387-67d678f21e47 (c6045cdf-baee-4063-b387-67d678f21e47): created successfully Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5273ca-e65c-47bc-aa94-ca81047a07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (d5f3ba0a-0ee4-4215-9a0c-6897162a28af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-263b3650-ae66-4482-bc13-117cf86b04f9 tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:41:51 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa 1073741824" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:51 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa Nov 03 07:41:51 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:51 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110e9da5-2dd0-478c-97ed-3f44d5603bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbb3e00-bae5-474d-9301-3254a61f34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Volume volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa (2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa): created successfully Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbb3e00-bae5-474d-9301-3254a61f34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Flow 'volume_create_manager' (ab716d70-39d5-4174-9387-de798a2f85bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-af0557c4-1089-4b36-9a8e-5e506d0e670a tempest-VolumesDeleteCascade-1782119066 None] Created volume successfully. Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (9fc21cd9-9364-4276-bcd6-79b342532ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8f24a9-1baa-4b32-972d-678154b88683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8f24a9-1baa-4b32-972d-678154b88683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-225432594',display_name='tempest-VolumesGetTest-Volume-1401317579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1759cf4f-81a3-47a6-897d-70c5ec93ac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:52Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b605dd1c-70db-4487-bcc2-8a1513c65cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b605dd1c-70db-4487-bcc2-8a1513c65cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90cd17f-1fe4-41d3-a26f-c80c8d61bf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90cd17f-1fe4-41d3-a26f-c80c8d61bf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1759cf4f-81a3-47a6-897d-70c5ec93ac38', 'volume_name': 'volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cdbb2c-e57f-467e-be14-f436a62d8917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cdbb2c-e57f-467e-be14-f436a62d8917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15de09be-ea67-42ab-8df5-68cdb98028e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Volume 1759cf4f-81a3-47a6-897d-70c5ec93ac38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38', 'volume_size': 1} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-225432594',display_name='tempest-VolumesGetTest-Volume-1401317579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1759cf4f-81a3-47a6-897d-70c5ec93ac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:52Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Creating volume 1759cf4f-81a3-47a6-897d-70c5ec93ac38 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:51 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 1073741824 Nov 03 07:41:51 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:52 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 1073741824" returned: 0 in 0.610s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 Nov 03 07:41:52 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38" returned: 0 in 0.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.503s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Creating offline snapshot 5de0538a-6c00-4039-afeb-3966580a6d6f of volume 2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15de09be-ea67-42ab-8df5-68cdb98028e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bb92e3-dfa5-42ab-ba55-08d3fabb7037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd493726-60f6-4068-892d-e8654fd8dbc2]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Volume volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 (1759cf4f-81a3-47a6-897d-70c5ec93ac38): created successfully Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bb92e3-dfa5-42ab-ba55-08d3fabb7037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (9fc21cd9-9364-4276-bcd6-79b342532ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b7072022-5c66-434d-a874-80ec98b795d2 tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:41:52 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa Nov 03 07:41:52 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:53 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:53 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f 1G Nov 03 07:41:53 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Flow 'volume_create_manager' (8bacde32-9cde-48f4-ae5b-6572438308d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6877e-ad8c-473b-aa54-bd45df49bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6877e-ad8c-473b-aa54-bd45df49bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-538624011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b12f85e-4792-4bde-b7ea-c0f843f3eb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf0e728c1784c4ea8d0cda2c8e015e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:54Z,use_quota=True,user_id='50eb32ad645a4484ab26c91927af7a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e7742f-a5f0-4c3e-9ecb-c9b345f8e2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e7742f-a5f0-4c3e-9ecb-c9b345f8e2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8511716b-9420-48b4-aeea-0f59eae46b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:41:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-1759cf4f-81a3-47a6-897d-70c5ec93ac38-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Lock "cinder-1759cf4f-81a3-47a6-897d-70c5ec93ac38-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:54 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f 1G" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f Nov 03 07:41:54 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-1759cf4f-81a3-47a6-897d-70c5ec93ac38" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-1759cf4f-81a3-47a6-897d-70c5ec93ac38" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[01509828-6dc6-4c80-a0ef-2b705ef92e54]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 Nov 03 07:41:54 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8511716b-9420-48b4-aeea-0f59eae46b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b12f85e-4792-4bde-b7ea-c0f843f3eb59', 'volume_name': 'volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa5240d-ae80-47f9-9caf-2d7f81eabb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa5240d-ae80-47f9-9caf-2d7f81eabb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5d11d8-a2dc-477f-b5ff-56ea1db197d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Volume 6b12f85e-4792-4bde-b7ea-c0f843f3eb59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Trying to clone 6b12f85e-4792-4bde-b7ea-c0f843f3eb59 from image 4c501e6d-7c58-4118-a8ef-07458ac1339d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:54 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f" returned: 0 in 0.446s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f is being set with open permissions: ugo+rw Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f Nov 03 07:41:54 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38" returned: 0 in 0.640s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38 Nov 03 07:41:54 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:41:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:41:55 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:41:55 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f" returned: 0 in 0.525s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f19e91-bc2d-4fbb-b64b-42c1819038b1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info Nov 03 07:41:55 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1759cf4f-81a3-47a6-897d-70c5ec93ac38" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-1759cf4f-81a3-47a6-897d-70c5ec93ac38" released by "delete_volume" :: held 1.127s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:55 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD Nov 03 07:41:55 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Created reservations ['d206f884-f2d6-459f-98d9-ea70e18d298e', 'ebf196bf-57c1-4b12-bc06-8d7e8648110a', '4df82943-9475-4e8c-97be-adea7e318e01', '85a3baa1-5a55-46ab-87c0-5b1f891d3dbb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:55 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info is being set with open permissions: ugo+rw Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d is fetched for user 50eb32ad645a4484ab26c91927af7a08. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:41:55 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info Nov 03 07:41:55 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7deb07-7261-4440-89b5-33d08380081a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc4ba96a-296a-44e4-ac52-ff03c44def70 tempest-VolumesGetTest-1200539598 None] Lock "cinder-1759cf4f-81a3-47a6-897d-70c5ec93ac38-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:55 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD Nov 03 07:41:55 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.info" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b1ad3bb0-06dc-42a7-bf06-f1883ecbfdaa tempest-VolumesDeleteCascade-1782119066 None] Create snapshot completed successfully Nov 03 07:41:56 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-538624011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b12f85e-4792-4bde-b7ea-c0f843f3eb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf0e728c1784c4ea8d0cda2c8e015e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:54Z,use_quota=True,user_id='50eb32ad645a4484ab26c91927af7a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Creating volume 6b12f85e-4792-4bde-b7ea-c0f843f3eb59 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:56 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:56 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 1073741824 Nov 03 07:41:56 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-c6045cdf-baee-4063-b387-67d678f21e47-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Lock "cinder-c6045cdf-baee-4063-b387-67d678f21e47-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-c6045cdf-baee-4063-b387-67d678f21e47" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-c6045cdf-baee-4063-b387-67d678f21e47" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f53460-4171-4cfa-a6c4-e1b90406892c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:56 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 Nov 03 07:41:56 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:56 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 1073741824" returned: 0 in 0.649s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:56 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 Nov 03 07:41:56 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47" returned: 0 in 0.569s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47 Nov 03 07:41:57 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Attempting download of 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 6b12f85e-4792-4bde-b7ea-c0f843f3eb59. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dfd46c-4816-4830-b98e-cd161a769997]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Flow 'volume_create_manager' (9ce4acf6-0707-44d8-845e-2ff66f1a23ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4ed328-2105-4acd-aaf1-037dc9f64bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4ed328-2105-4acd-aaf1-037dc9f64bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-819395460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea084d53-9beb-46bb-9a8b-e9833b168a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa37e9d7fe164473bc8a703b16aac9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5de0538a-6c00-4039-afeb-3966580a6d6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:57Z,use_quota=True,user_id='ce39d64c658c4e32a53912796ae215bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ade1d5-206f-487b-8f98-e2e5f83ad237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ade1d5-206f-487b-8f98-e2e5f83ad237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae895c6-287e-485e-9bfb-68739e3a65a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge Nov 03 07:41:57 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae895c6-287e-485e-9bfb-68739e3a65a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea084d53-9beb-46bb-9a8b-e9833b168a2c', 'volume_name': 'volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c', 'volume_size': 1, 'snapshot_id': '5de0538a-6c00-4039-afeb-3966580a6d6f'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054dee03-44dd-408a-8520-a4381ae97665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054dee03-44dd-408a-8520-a4381ae97665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b072d8a1-41a6-4091-9e14-0704a71ab8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Volume ea084d53-9beb-46bb-9a8b-e9833b168a2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c', 'volume_size': 1, 'snapshot_id': '5de0538a-6c00-4039-afeb-3966580a6d6f'} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c6045cdf-baee-4063-b387-67d678f21e47" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-c6045cdf-baee-4063-b387-67d678f21e47" released by "delete_volume" :: held 1.004s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-5de0538a-6c00-4039-afeb-3966580a6d6f-ea084d53-9beb-46bb-9a8b-e9833b168a2c" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-5de0538a-6c00-4039-afeb-3966580a6d6f-ea084d53-9beb-46bb-9a8b-e9833b168a2c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Creating volume ea084d53-9beb-46bb-9a8b-e9833b168a2c from snapshot 5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-ea084d53-9beb-46bb-9a8b-e9833b168a2c" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-ea084d53-9beb-46bb-9a8b-e9833b168a2c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] snapshot: 5de0538a-6c00-4039-afeb-3966580a6d6f, volume: ea084d53-9beb-46bb-9a8b-e9833b168a2c, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6595d999-4bb1-4d38-ba52-b783c865bacc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Created reservations ['da8c8fb2-ebc5-4019-acf3-287b95dd4770', '15427fed-c4f5-4d35-ae7d-33098ab27b2c', 'bf738b60-5908-4be4-bc94-d33447be948d', '628d0c83-64cd-47f9-9c3f-05153e3428b2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:57 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f Nov 03 07:41:57 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge Nov 03 07:41:57 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:41:57 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f" returned: 0 in 0.502s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76aeada-e8c2-44f5-aeec-7950706fe341]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge" returned: 1 in 0.454s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_4ce6n3ge' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65d0d94-3018-44db-ba19-597cbe7b2c37]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15a537e9-452d-4700-aa62-30e0511473b5 tempest-VolumesGetTest-1200539598 None] Lock "cinder-c6045cdf-baee-4063-b387-67d678f21e47-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:58 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa Nov 03 07:41:58 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD Nov 03 07:41:58 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] 4c501e6d-7c58-4118-a8ef-07458ac1339d was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:41:58 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 Nov 03 07:41:58 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c Nov 03 07:41:58 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Lock "cinder-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ef767-632e-4680-952e-9cef2e5e8553]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 Nov 03 07:41:59 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:59 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7 Nov 03 07:41:59 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:00 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7" released by "delete_volume" :: held 1.402s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Created reservations ['4d7f0adc-29c6-48a0-a629-a246155d889c', '2488beb8-a04b-4fee-918d-9a0eeeb0be6a', '9d90a0a2-108a-422f-993f-f5ea076baae1', '6cedf648-39db-4ee7-8f9b-6bbd6a8c9245'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:00 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:00 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:01 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.536s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:42:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8aa3fd6e-7e01-41a7-b338-8af718ce2459 tempest-VolumesGetTest-1200539598 None] Lock "cinder-c4f8f0b7-c0cf-4fa5-aea6-d7bd160504b7-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (4f319517-9d01-4c32-a0c9-a31313dfee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93f9626-4ca1-40be-a06f-dd77c9ea315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93f9626-4ca1-40be-a06f-dd77c9ea315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1529549260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b421c542-dd78-495b-9132-936678188cb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:03Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6553ca72-5fdf-4fbb-b27d-7eacd02c1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6553ca72-5fdf-4fbb-b27d-7eacd02c1499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d52d1f-25e8-46be-9c7c-3d8250dbd936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:03 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d52d1f-25e8-46be-9c7c-3d8250dbd936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b421c542-dd78-495b-9132-936678188cb2', 'volume_name': 'volume-b421c542-dd78-495b-9132-936678188cb2', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defc82f5-6d2c-458a-a9b9-6e541d386178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defc82f5-6d2c-458a-a9b9-6e541d386178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7ffaf5-118d-445a-86de-b96d016a85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Volume b421c542-dd78-495b-9132-936678188cb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b421c542-dd78-495b-9132-936678188cb2', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Trying to clone b421c542-dd78-495b-9132-936678188cb2 from image 4c501e6d-7c58-4118-a8ef-07458ac1339d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:42:04 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" returned: 0 in 6.232s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_q1ng67o2devstack@QuobyteHD, size 112.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:04 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Converted 112.00 MB image at 17.96 MB/s Nov 03 07:42:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 1G Nov 03 07:42:05 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:42:05 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e4097-f808-450b-821a-c75b35b88170]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD Nov 03 07:42:05 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 1G" returned: 0 in 0.909s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Downloaded image 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 6b12f85e-4792-4bde-b7ea-c0f843f3eb59 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d for user 50eb32ad645a4484ab26c91927af7a08 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Marking volume 6b12f85e-4792-4bde-b7ea-c0f843f3eb59 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Copying metadata from image 4c501e6d-7c58-4118-a8ef-07458ac1339d to 6b12f85e-4792-4bde-b7ea-c0f843f3eb59. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Creating volume glance metadata for volume 6b12f85e-4792-4bde-b7ea-c0f843f3eb59 backed by image 4c501e6d-7c58-4118-a8ef-07458ac1339d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:42:05 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d is fetched for user 42f8a27d5105489d8134da88f1a5c822. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:42:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5d11d8-a2dc-477f-b5ff-56ea1db197d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c983210f-9da0-4f2f-9242-efbe4ebfc5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Volume volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 (6b12f85e-4792-4bde-b7ea-c0f843f3eb59): created successfully Nov 03 07:42:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c983210f-9da0-4f2f-9242-efbe4ebfc5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Flow 'volume_create_manager' (8bacde32-9cde-48f4-ae5b-6572438308d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4fd568d5-3911-4104-b49c-8430542199f8 tempest-TestShelveInstance-258390742 None] Created volume successfully. Nov 03 07:42:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d3e5fa-baaa-4187-98bb-b706d6a321b4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:06 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD Nov 03 07:42:06 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:07 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:08 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c" returned: 0 in 9.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa, size 1024.00 MB, duration 9.82 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:08 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Converted 1024.00 MB image at 104.30 MB/s Nov 03 07:42:08 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c is being set with open permissions: ugo+rw Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:08 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c Nov 03 07:42:08 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:08 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-ea084d53-9beb-46bb-9a8b-e9833b168a2c" released by "_copy_volume_from_snapshot" :: held 11.238s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-5de0538a-6c00-4039-afeb-3966580a6d6f-ea084d53-9beb-46bb-9a8b-e9833b168a2c" released by "_create_volume_from_snapshot" :: held 11.331s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.364s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1529549260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b421c542-dd78-495b-9132-936678188cb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:03Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Creating volume b421c542-dd78-495b-9132-936678188cb2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:08 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 1073741824 Nov 03 07:42:08 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b072d8a1-41a6-4091-9e14-0704a71ab8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c', 'volume_size': 1, 'snapshot_id': '5de0538a-6c00-4039-afeb-3966580a6d6f'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b251e48-14b3-441f-b5cd-9b9718578283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Volume volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c (ea084d53-9beb-46bb-9a8b-e9833b168a2c): created successfully Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b251e48-14b3-441f-b5cd-9b9718578283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Flow 'volume_create_manager' (9ce4acf6-0707-44d8-845e-2ff66f1a23ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b1469377-4b05-4c44-a899-5250d1bf6cc9 tempest-VolumesDeleteCascade-1782119066 None] Created volume successfully. Nov 03 07:42:09 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 1073741824" returned: 0 in 0.567s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:09 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 Nov 03 07:42:09 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:09 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Attempting download of 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume b421c542-dd78-495b-9132-936678188cb2. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:42:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabcee60-85b6-46ff-9a0d-27c3cf25aaa3]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Performing cascade delete. {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-5de0538a-6c00-4039-afeb-3966580a6d6f-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-5de0538a-6c00-4039-afeb-3966580a6d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-5de0538a-6c00-4039-afeb-3966580a6d6f" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-5de0538a-6c00-4039-afeb-3966580a6d6f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Deleting offline snapshot 5de0538a-6c00-4039-afeb-3966580a6d6f of volume 2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] snapshot_file for this snap is: volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40ae11d-553e-4ff0-b762-a35fbd5da4f4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw Nov 03 07:42:10 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Flow 'volume_create_manager' (bd7870bd-1260-49ca-b809-c1eb83eb3e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716a63ab-6a4e-4205-b8d3-4b168645db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716a63ab-6a4e-4205-b8d3-4b168645db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1733535588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468e3574-77cc-4b5d-9560-aaa64866c082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1625816a3804095bdc023ddb37866a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:10Z,use_quota=True,user_id='c3cf9e54afd344a1b30361a51d28725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b83e2e-348c-4cac-b2bf-d2b433fe3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b83e2e-348c-4cac-b2bf-d2b433fe3123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:10 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f Nov 03 07:42:10 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a31948d-b131-402f-92e4-324fd8bc3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a31948d-b131-402f-92e4-324fd8bc3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468e3574-77cc-4b5d-9560-aaa64866c082', 'volume_name': 'volume-468e3574-77cc-4b5d-9560-aaa64866c082', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67754b1-9517-46d9-b58c-e3f121820624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67754b1-9517-46d9-b58c-e3f121820624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc7ad9a-dbab-4d7e-b92a-79a27189569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Volume 468e3574-77cc-4b5d-9560-aaa64866c082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468e3574-77cc-4b5d-9560-aaa64866c082', 'volume_size': 1} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1733535588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468e3574-77cc-4b5d-9560-aaa64866c082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1625816a3804095bdc023ddb37866a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:10Z,use_quota=True,user_id='c3cf9e54afd344a1b30361a51d28725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Creating volume 468e3574-77cc-4b5d-9560-aaa64866c082 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 1073741824 Nov 03 07:42:10 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw Nov 03 07:42:10 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f" returned: 0 in 0.532s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e0d93d-3ec4-4436-baea-8ddb0a9a3917]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa Nov 03 07:42:10 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:11 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw" returned: 1 in 0.543s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_varjzrvw' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f12612-a126-4865-aa1e-d55aa99ae309]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:11 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 1073741824" returned: 0 in 0.686s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:11 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD Nov 03 07:42:11 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 Nov 03 07:42:11 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:11 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:11 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:11 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] 4c501e6d-7c58-4118-a8ef-07458ac1339d was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:11 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 Nov 03 07:42:11 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc7ad9a-dbab-4d7e-b92a-79a27189569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468e3574-77cc-4b5d-9560-aaa64866c082', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c9dce9-4a12-4525-985a-34e4350ddc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:11 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" returned: 0 in 0.878s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Volume volume-468e3574-77cc-4b5d-9560-aaa64866c082 (468e3574-77cc-4b5d-9560-aaa64866c082): created successfully Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c9dce9-4a12-4525-985a-34e4350ddc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Flow 'volume_create_manager' (bd7870bd-1260-49ca-b809-c1eb83eb3e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:11 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f Nov 03 07:42:11 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3810fbc7-0096-4b6f-afcd-2368529e0c3d req-2e086539-7bea-4324-a57e-dd8e1403b2ae tempest-TestShelveInstance-258390742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3810fbc7-0096-4b6f-afcd-2368529e0c3d req-2e086539-7bea-4324-a57e-dd8e1403b2ae tempest-TestShelveInstance-258390742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-78cc9a1b-cec2-4f0b-90b5-719b77ea7bb1 tempest-AbsoluteLimitsTests-1688134533 None] Created volume successfully. Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3810fbc7-0096-4b6f-afcd-2368529e0c3d req-2e086539-7bea-4324-a57e-dd8e1403b2ae tempest-TestShelveInstance-258390742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-3810fbc7-0096-4b6f-afcd-2368529e0c3d req-2e086539-7bea-4324-a57e-dd8e1403b2ae tempest-TestShelveInstance-258390742 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b697a654-726c-40e4-a3b3-3f67bb689ca7', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:42:11 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=119,cinder:INSERT=42,cinder:UPDATE=145,cinder:DELETE=12 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-3810fbc7-0096-4b6f-afcd-2368529e0c3d req-2e086539-7bea-4324-a57e-dd8e1403b2ae tempest-TestShelveInstance-258390742 None] attachment_update completed successfully. Nov 03 07:42:12 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f" returned: 0 in 0.528s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:12 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f Nov 03 07:42:12 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:12 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa.5de0538a-6c00-4039-afeb-3966580a6d6f" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-5de0538a-6c00-4039-afeb-3966580a6d6f" released by "_delete_snapshot" :: held 2.550s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" released by "delete_snapshot" :: held 2.585s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=123,cinder:INSERT=39,cinder:UPDATE=142,cinder:DELETE=15 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Created reservations ['0e08fbb4-b7bb-4930-8ee4-f685a56936c7', 'a50a7d35-3ea1-4739-b298-82adf1e0f734', '5876c54d-ea9f-41cb-bbc3-d526944345be', '5379d555-d7c3-4e32-a2af-321d8c2d711b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Acquiring lock "cinder-468e3574-77cc-4b5d-9560-aaa64866c082-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Lock "cinder-468e3574-77cc-4b5d-9560-aaa64866c082-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Acquiring lock "cinder-quobyte-468e3574-77cc-4b5d-9560-aaa64866c082" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Lock "cinder-quobyte-468e3574-77cc-4b5d-9560-aaa64866c082" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Delete snapshot completed successfully. Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f42e3c-fbfd-421e-af70-af773fe82fed]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-5de0538a-6c00-4039-afeb-3966580a6d6f-delete_snapshot" released by "delete_snapshot" :: held 2.974s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Snapshots deleted, issuing volume delete {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" acquired by "delete_volume" :: waited 0.059s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519ced8-83bc-411d-a610-dd3156eca6c1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:13 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 Nov 03 07:42:13 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:13 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa Nov 03 07:42:13 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:13 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082" returned: 0 in 0.619s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:13 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082 Nov 03 07:42:13 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:13 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" returned: 0 in 0.670s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:13 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa Nov 03 07:42:13 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:14 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-468e3574-77cc-4b5d-9560-aaa64866c082" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Lock "cinder-quobyte-468e3574-77cc-4b5d-9560-aaa64866c082" released by "delete_volume" :: held 1.113s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Created reservations ['1ea3ec67-2fd8-431e-87f4-1d15b401adcf', '24c18ebb-485f-4eae-9229-c357270a07b4', '055ec3d3-0d25-42c1-b143-33909f6306ac', 'ac3e8a68-62dc-49f0-a32d-9f0036fba3a1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:14 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" returned: 0 in 0.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa" released by "delete_volume" :: held 1.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Created reservations ['3052dc1d-4a72-4c0a-a9d1-aaa4fb562151', '85d3463f-2393-4cc2-844a-7b61cefc086a', '79e2e1b5-3c3e-41b3-8181-c410108d7d0f', '26c18946-a69c-4df0-a8c2-beaf0bf2c260'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:14 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:14 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:14 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:14 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:14 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2" returned: 0 in 3.099s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_v3mjgq75devstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:14 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Converted 112.00 MB image at 36.12 MB/s Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:14 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 1G Nov 03 07:42:14 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:14 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.488s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Deleted volume successfully. Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19ac534a-78fb-455c-a6d6-0f88393d9515 tempest-AbsoluteLimitsTests-1688134533 None] Lock "cinder-468e3574-77cc-4b5d-9560-aaa64866c082-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:14 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.400s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Deleted volume successfully. Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8025b245-c565-45c4-96d0-5ad00beae261 tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-2aa5e9dd-e7b0-4e8c-a87d-f4ac1d5bd8aa-delete_volume" released by "delete_volume" :: held 5.032s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:15 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 1G" returned: 0 in 0.486s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Downloaded image 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume b421c542-dd78-495b-9132-936678188cb2 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d for user 42f8a27d5105489d8134da88f1a5c822 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Marking volume b421c542-dd78-495b-9132-936678188cb2 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Copying metadata from image 4c501e6d-7c58-4118-a8ef-07458ac1339d to b421c542-dd78-495b-9132-936678188cb2. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Creating volume glance metadata for volume b421c542-dd78-495b-9132-936678188cb2 backed by image 4c501e6d-7c58-4118-a8ef-07458ac1339d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7ffaf5-118d-445a-86de-b96d016a85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b421c542-dd78-495b-9132-936678188cb2', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a12f78-ddf2-4470-87c0-d6989f79f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Volume volume-b421c542-dd78-495b-9132-936678188cb2 (b421c542-dd78-495b-9132-936678188cb2): created successfully Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a12f78-ddf2-4470-87c0-d6989f79f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (4f319517-9d01-4c32-a0c9-a31313dfee78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-64a01d7c-2b45-43bc-850b-bae1ea4d27be tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-ea084d53-9beb-46bb-9a8b-e9833b168a2c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-ea084d53-9beb-46bb-9a8b-e9833b168a2c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "cinder-quobyte-ea084d53-9beb-46bb-9a8b-e9833b168a2c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-ea084d53-9beb-46bb-9a8b-e9833b168a2c" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[61695a2a-91e7-4e16-9aa7-0cc9e07d851c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:16 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c Nov 03 07:42:16 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:16 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c" returned: 0 in 0.620s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:16 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c Nov 03 07:42:16 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:17 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ea084d53-9beb-46bb-9a8b-e9833b168a2c" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-quobyte-ea084d53-9beb-46bb-9a8b-e9833b168a2c" released by "delete_volume" :: held 1.210s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Created reservations ['60170218-d51b-4061-adbe-e5bc3fbbfdce', '87202bf7-830b-48d9-85f5-1ac8a6c2c5ce', 'f359a076-d139-4fcd-9992-76fee2849184', '7e6c2375-7cda-48e3-8502-67655e9200c5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:17 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:17 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:17 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (1d5bf274-3ca1-423b-9876-a3d74fa3f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c1116a-ffb4-435e-8070-dd8a6edc77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Deleted volume successfully. Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c1116a-ffb4-435e-8070-dd8a6edc77a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1153294216',display_name='tempest-VolumesGetTest-Volume-1149425262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df41e78-05e3-4a96-a2d2-2b946fb4ff5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:18Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f934192-4ac9-4544-9dcb-cb2bd052cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f934192-4ac9-4544-9dcb-cb2bd052cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a67f01c-5517-460c-81c1-03f2fc533119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a67f01c-5517-460c-81c1-03f2fc533119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df41e78-05e3-4a96-a2d2-2b946fb4ff5c', 'volume_name': 'volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d739d2e-adf1-432b-922d-a50cec549e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d739d2e-adf1-432b-922d-a50cec549e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7682302-6e51-4e4b-b132-8453786a76a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Volume 4df41e78-05e3-4a96-a2d2-2b946fb4ff5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c', 'volume_size': 1} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1153294216',display_name='tempest-VolumesGetTest-Volume-1149425262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df41e78-05e3-4a96-a2d2-2b946fb4ff5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7712931922a46d4b8120931bfbf072d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:18Z,use_quota=True,user_id='42f8a27d5105489d8134da88f1a5c822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Creating volume 4df41e78-05e3-4a96-a2d2-2b946fb4ff5c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed583f31-1b17-4523-809e-757a58a1ba5b tempest-VolumesDeleteCascade-1782119066 None] Lock "cinder-ea084d53-9beb-46bb-9a8b-e9833b168a2c-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:18 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c 1073741824 Nov 03 07:42:18 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:19 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c 1073741824" returned: 0 in 0.873s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:19 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c Nov 03 07:42:19 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:19 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c" returned: 0 in 0.425s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7682302-6e51-4e4b-b132-8453786a76a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff3a13c-6373-444c-a53e-c02b7494ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Volume volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c (4df41e78-05e3-4a96-a2d2-2b946fb4ff5c): created successfully Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff3a13c-6373-444c-a53e-c02b7494ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Flow 'volume_create_manager' (1d5bf274-3ca1-423b-9876-a3d74fa3f295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bb72387c-538f-4593-87d0-e4f6b882a205 tempest-VolumesGetTest-1200539598 None] Created volume successfully. Nov 03 07:42:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Lock "cinder-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd2480-35fb-4260-b723-4cd7ee6b7ad8]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:20 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c Nov 03 07:42:20 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:21 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c" returned: 0 in 0.668s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:21 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c Nov 03 07:42:21 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:21 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c" returned: 0 in 0.543s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c" released by "delete_volume" :: held 1.302s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Created reservations ['0db8dbea-754a-4ee2-81ca-c6023e531bbb', 'a2bb01ba-231d-440e-ac88-2f29edb44944', '0a983ad4-6a67-4685-890a-8105afe4abf3', 'd1b18b04-42b8-4700-97b1-3952389087d6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:22 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:22 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:22 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7f95c7-e7ff-4e6f-ba5d-f88ac7b78413 tempest-VolumesGetTest-1200539598 None] Lock "cinder-4df41e78-05e3-4a96-a2d2-2b946fb4ff5c-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-b421c542-dd78-495b-9132-936678188cb2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Lock "cinder-b421c542-dd78-495b-9132-936678188cb2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Acquiring lock "cinder-quobyte-b421c542-dd78-495b-9132-936678188cb2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-b421c542-dd78-495b-9132-936678188cb2" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d53092-db2a-4851-ae97-e733e1933186]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:23 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 Nov 03 07:42:23 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:24 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2" returned: 0 in 0.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:24 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2 Nov 03 07:42:24 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:24 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b421c542-dd78-495b-9132-936678188cb2" returned: 0 in 0.662s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Lock "cinder-quobyte-b421c542-dd78-495b-9132-936678188cb2" released by "delete_volume" :: held 1.373s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Created reservations ['779052fc-0e06-4d09-a5ff-3477e2148ba5', 'b622b7bc-d9f8-4746-af2c-315f9b5401eb', '544398e7-7fe3-425a-8f25-13bfadd741a8', '3b716e6f-9800-4b8f-87fb-a2ca49eda1e7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:25 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:25 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:25 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.570s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Deleted volume successfully. Nov 03 07:42:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-adf7b8d1-e5a3-42c7-a6b9-8d9a157e5027 tempest-VolumesGetTest-1200539598 None] Lock "cinder-b421c542-dd78-495b-9132-936678188cb2-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Flow 'volume_create_manager' (5ecd3242-0faa-4b8f-be7b-b3f882f74f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b33450-7b82-43c3-a9b6-cb6f7fc427a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b33450-7b82-43c3-a9b6-cb6f7fc427a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1635215451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f14be23-2642-4e0a-aa71-ea6fe0169944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e7ed94a3864e50bbabe77e970cef7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:27Z,use_quota=True,user_id='d9de8d8d8bd941bcb1dbce69f000069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8f6bc7-9d48-49a6-bbef-080099678a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8f6bc7-9d48-49a6-bbef-080099678a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06054f2-db9c-4f18-a95c-7850329a8c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06054f2-db9c-4f18-a95c-7850329a8c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f14be23-2642-4e0a-aa71-ea6fe0169944', 'volume_name': 'volume-9f14be23-2642-4e0a-aa71-ea6fe0169944', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de46ebb1-541e-4507-8c3c-3770a8fe1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de46ebb1-541e-4507-8c3c-3770a8fe1f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983b8c1d-a5b0-42b1-820a-4bc56a6fea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Volume 9f14be23-2642-4e0a-aa71-ea6fe0169944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f14be23-2642-4e0a-aa71-ea6fe0169944', 'volume_size': 1} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1635215451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f14be23-2642-4e0a-aa71-ea6fe0169944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e7ed94a3864e50bbabe77e970cef7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:27Z,use_quota=True,user_id='d9de8d8d8bd941bcb1dbce69f000069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Creating volume 9f14be23-2642-4e0a-aa71-ea6fe0169944 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:26 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:26 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 1073741824 Nov 03 07:42:26 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:27 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 1073741824" returned: 0 in 0.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:27 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 Nov 03 07:42:27 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:28 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983b8c1d-a5b0-42b1-820a-4bc56a6fea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f14be23-2642-4e0a-aa71-ea6fe0169944', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07408754-0497-4b87-8803-7c409147cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Volume volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 (9f14be23-2642-4e0a-aa71-ea6fe0169944): created successfully Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07408754-0497-4b87-8803-7c409147cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Flow 'volume_create_manager' (5ecd3242-0faa-4b8f-be7b-b3f882f74f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f7157633-a665-4919-b2ac-d636adb72705 tempest-VolumesMetadataTest-1567487672 None] Created volume successfully. Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Flow 'volume_create_manager' (bdd44aad-5abe-49e7-9abf-77a06ed5ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ca634b-3f81-4e43-bd3c-166098615c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ca634b-3f81-4e43-bd3c-166098615c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-355232368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eafbceb-040e-43b5-a332-931687254db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1aabfcb7be4157b3c5433b6716b6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:29Z,use_quota=True,user_id='7cef34ec52d84cba8e7a8c20c23334af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59bde22-1d51-4077-8c50-93397482dbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59bde22-1d51-4077-8c50-93397482dbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272dab54-216d-402a-aee7-6a79745e4b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272dab54-216d-402a-aee7-6a79745e4b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eafbceb-040e-43b5-a332-931687254db8', 'volume_name': 'volume-0eafbceb-040e-43b5-a332-931687254db8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433f06a2-0f98-4930-b60d-06f848f68319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433f06a2-0f98-4930-b60d-06f848f68319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87acd8f4-15ed-46bc-9e64-2f0126e7567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Volume 0eafbceb-040e-43b5-a332-931687254db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eafbceb-040e-43b5-a332-931687254db8', 'volume_size': 1} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-355232368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eafbceb-040e-43b5-a332-931687254db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1aabfcb7be4157b3c5433b6716b6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:29Z,use_quota=True,user_id='7cef34ec52d84cba8e7a8c20c23334af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Creating volume 0eafbceb-040e-43b5-a332-931687254db8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:29 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 1073741824 Nov 03 07:42:29 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Acquiring lock "cinder-9f14be23-2642-4e0a-aa71-ea6fe0169944-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 1073741824" returned: 0 in 0.737s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Lock "cinder-9f14be23-2642-4e0a-aa71-ea6fe0169944-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 Nov 03 07:42:30 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Acquiring lock "cinder-quobyte-9f14be23-2642-4e0a-aa71-ea6fe0169944" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Lock "cinder-quobyte-9f14be23-2642-4e0a-aa71-ea6fe0169944" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbb336-ef06-4dd2-9146-9b0f833fe4ed]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 Nov 03 07:42:30 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87acd8f4-15ed-46bc-9e64-2f0126e7567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eafbceb-040e-43b5-a332-931687254db8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25785d65-2648-4cc9-8b01-faac10f81fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Volume volume-0eafbceb-040e-43b5-a332-931687254db8 (0eafbceb-040e-43b5-a332-931687254db8): created successfully Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25785d65-2648-4cc9-8b01-faac10f81fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Flow 'volume_create_manager' (bdd44aad-5abe-49e7-9abf-77a06ed5ea11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-17273bbd-3823-4693-a040-c709489a1d11 tempest-VolumesTransfersTest-1120351767 None] Created volume successfully. Nov 03 07:42:30 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944" returned: 0 in 0.554s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944 Nov 03 07:42:30 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:31 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9f14be23-2642-4e0a-aa71-ea6fe0169944" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Lock "cinder-quobyte-9f14be23-2642-4e0a-aa71-ea6fe0169944" released by "delete_volume" :: held 0.970s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Created reservations ['36e86094-24f8-4aed-b399-f5f812d91793', 'f742d44e-a52a-4d43-92f8-0a0c34878a55', '6cf4b764-80ee-43a5-a882-781035741ad6', '799c52e3-f443-471d-a568-ffa12b9f676b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:31 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:31 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:31 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Deleted volume successfully. Nov 03 07:42:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-51dea5cd-dfbf-48c9-a2e4-4b9e05fc97be tempest-VolumesMetadataTest-1567487672 None] Lock "cinder-9f14be23-2642-4e0a-aa71-ea6fe0169944-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d689736e-357a-441e-808d-4d7c9e92cc45 tempest-VolumesTransfersTest-507590283 None] Transfer volume completed successfully. Nov 03 07:42:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Acquiring lock "cinder-0eafbceb-040e-43b5-a332-931687254db8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Lock "cinder-0eafbceb-040e-43b5-a332-931687254db8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Acquiring lock "cinder-quobyte-0eafbceb-040e-43b5-a332-931687254db8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Lock "cinder-quobyte-0eafbceb-040e-43b5-a332-931687254db8" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2d6d63-32eb-47ac-a782-a7b520c6d72d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 Nov 03 07:42:33 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8" returned: 0 in 0.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:34 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8 Nov 03 07:42:34 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0eafbceb-040e-43b5-a332-931687254db8" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Lock "cinder-quobyte-0eafbceb-040e-43b5-a332-931687254db8" released by "delete_volume" :: held 1.184s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Created reservations ['e8548e6e-bf92-43c5-8c91-063e39c261d9', 'a785171a-4b9c-4700-acd4-819892496051', '52768913-f6b0-4443-9689-638cd3265db5', 'bb4b64c1-a8fd-439b-b6c8-b424a31a6e6b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:35 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:35 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Deleted volume successfully. Nov 03 07:42:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edea19d2-4c9d-41fc-add0-fe4260a1783a tempest-VolumesTransfersTest-287373717 None] Lock "cinder-0eafbceb-040e-43b5-a332-931687254db8-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Flow 'volume_create_manager' (897a1842-3340-4694-9cbe-f75233a8306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fd57c1-9315-4a16-8869-63f6020c0c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fd57c1-9315-4a16-8869-63f6020c0c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1437557812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa47458-ce23-46bf-bf87-121e76cf8bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1aabfcb7be4157b3c5433b6716b6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:37Z,use_quota=True,user_id='7cef34ec52d84cba8e7a8c20c23334af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecd9367-78df-4db6-b9f8-8fc41085e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecd9367-78df-4db6-b9f8-8fc41085e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4318d4d-21b1-463d-b4a2-845abda7b3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4318d4d-21b1-463d-b4a2-845abda7b3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa47458-ce23-46bf-bf87-121e76cf8bbe', 'volume_name': 'volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2448c756-5635-488f-81c2-032c8bb79724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2448c756-5635-488f-81c2-032c8bb79724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c8582c-74f2-4819-907a-7fa2e7c0029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Volume 4aa47458-ce23-46bf-bf87-121e76cf8bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe', 'volume_size': 1} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1437557812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa47458-ce23-46bf-bf87-121e76cf8bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1aabfcb7be4157b3c5433b6716b6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:37Z,use_quota=True,user_id='7cef34ec52d84cba8e7a8c20c23334af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Creating volume 4aa47458-ce23-46bf-bf87-121e76cf8bbe {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:37 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe 1073741824 Nov 03 07:42:37 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:37 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe 1073741824" returned: 0 in 0.892s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:37 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe Nov 03 07:42:37 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:38 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c8582c-74f2-4819-907a-7fa2e7c0029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b7840f-4a77-4db2-b0ad-88a5a8a52085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Volume volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe (4aa47458-ce23-46bf-bf87-121e76cf8bbe): created successfully Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b7840f-4a77-4db2-b0ad-88a5a8a52085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Flow 'volume_create_manager' (897a1842-3340-4694-9cbe-f75233a8306c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d4aa88f3-1a5b-4634-b526-4d18f607d33c tempest-VolumesTransfersTest-1120351767 None] Created volume successfully. Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Acquiring lock "cinder-4aa47458-ce23-46bf-bf87-121e76cf8bbe-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Lock "cinder-4aa47458-ce23-46bf-bf87-121e76cf8bbe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Acquiring lock "cinder-quobyte-4aa47458-ce23-46bf-bf87-121e76cf8bbe" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Lock "cinder-quobyte-4aa47458-ce23-46bf-bf87-121e76cf8bbe" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfee28e-0bd9-478c-99db-3b9871680907]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:39 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe Nov 03 07:42:39 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:39 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe" returned: 0 in 0.482s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:39 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe Nov 03 07:42:39 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:40 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4aa47458-ce23-46bf-bf87-121e76cf8bbe" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Lock "cinder-quobyte-4aa47458-ce23-46bf-bf87-121e76cf8bbe" released by "delete_volume" :: held 0.879s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Created reservations ['d7591b2e-a3cf-46f3-925d-5595d5e5a271', 'bda56c0f-4c7f-495b-8e7c-9cf6dd5a467a', 'b9fcc128-2f75-4d4d-a254-46d13d4de45c', '6dfcff51-db8a-4a6e-9f4b-9f845d1a4799'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:40 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:40 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:40 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.443s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Deleted volume successfully. Nov 03 07:42:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fa5d807-b547-4ca4-9362-995512d924fa tempest-VolumesTransfersTest-287373717 None] Lock "cinder-4aa47458-ce23-46bf-bf87-121e76cf8bbe-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:50 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=20,cinder:UPDATE=82,cinder:SELECT=62,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:50 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=55,cinder:INSERT=32,cinder:UPDATE=85,cinder:DELETE=10 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:54 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:42:54 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:54 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:42:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Flow 'volume_create_manager' (f0ce388b-b099-4f6a-880e-3c1778935f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d79193-e1cc-409b-8db0-38b8a8f6b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d79193-e1cc-409b-8db0-38b8a8f6b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-547358516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5185bed-cb21-444e-9d80-da7bd6dd50b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10989824ce6a45fba09b7b98c348f4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:56Z,use_quota=True,user_id='5143beb21e404d11b7c1610e721fa771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c9edc7-700f-4b3c-9a5b-3fadb8ca23f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c9edc7-700f-4b3c-9a5b-3fadb8ca23f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85979cde-f713-4f23-b3f8-da819b0c2e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85979cde-f713-4f23-b3f8-da819b0c2e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5185bed-cb21-444e-9d80-da7bd6dd50b0', 'volume_name': 'volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611076b-8d0e-401b-85c5-f49e987a8acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611076b-8d0e-401b-85c5-f49e987a8acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fd15a9-9875-4c2b-b0c8-511dcdeed48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Volume a5185bed-cb21-444e-9d80-da7bd6dd50b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0', 'volume_size': 1} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-547358516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5185bed-cb21-444e-9d80-da7bd6dd50b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10989824ce6a45fba09b7b98c348f4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:56Z,use_quota=True,user_id='5143beb21e404d11b7c1610e721fa771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Creating volume a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:42:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:56 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 1073741824 Nov 03 07:42:56 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:56 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 1073741824" returned: 0 in 0.662s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:56 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:42:56 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:57 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fd15a9-9875-4c2b-b0c8-511dcdeed48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5225c290-09b0-45a3-879b-f9306050047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Volume volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 (a5185bed-cb21-444e-9d80-da7bd6dd50b0): created successfully Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5225c290-09b0-45a3-879b-f9306050047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Flow 'volume_create_manager' (f0ce388b-b099-4f6a-880e-3c1778935f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fb92cbe8-9771-4f9b-a8b8-573ebca75048 tempest-VolumesActionsTest-1445225575 None] Created volume successfully. Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Flow 'volume_create_manager' (907790f2-e56f-4843-941b-1a5a2d5d334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea05eb57-92d2-4fd3-a56a-7c14ebb4cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea05eb57-92d2-4fd3-a56a-7c14ebb4cee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-652749368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6698c287-36b2-42ca-9f7a-9c762eb86e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0f425a36d2404e97532daa3317a4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:00Z,use_quota=True,user_id='9ecdf6f40bc742cd8be25381a020c0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133119b2-df3a-4c4f-9ee9-c1270dc0dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133119b2-df3a-4c4f-9ee9-c1270dc0dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc79ec4-f56c-4ea2-95ed-1a8b3e38a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc79ec4-f56c-4ea2-95ed-1a8b3e38a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6698c287-36b2-42ca-9f7a-9c762eb86e0a', 'volume_name': 'volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5ecd7-3c14-4142-ac9d-68630706c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5ecd7-3c14-4142-ac9d-68630706c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e6ca6c-fa93-4b86-a089-7378433640cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Volume 6698c287-36b2-42ca-9f7a-9c762eb86e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a', 'volume_size': 2} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-652749368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6698c287-36b2-42ca-9f7a-9c762eb86e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0f425a36d2404e97532daa3317a4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:00Z,use_quota=True,user_id='9ecdf6f40bc742cd8be25381a020c0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Creating volume 6698c287-36b2-42ca-9f7a-9c762eb86e0a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:00 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:43:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a 2147483648 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:00 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a 2147483648 Nov 03 07:43:00 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:01 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a 2147483648" returned: 0 in 0.914s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:01 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a Nov 03 07:43:01 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-33633a1a-c771-4c2b-afdd-09ce28b2147e req-4f52ffd1-13c1-4f69-bf01-6ce060031961 tempest-TestShelveInstance-258390742 None] Terminate volume connection completed successfully. Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-33633a1a-c771-4c2b-afdd-09ce28b2147e req-4f52ffd1-13c1-4f69-bf01-6ce060031961 tempest-TestShelveInstance-258390742 None] Deleting attachment b697a654-726c-40e4-a3b3-3f67bb689ca7. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:43:01 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e6ca6c-fa93-4b86-a089-7378433640cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06e3cf5-2bcf-492d-aeaf-f80cddfb6e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Volume volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a (6698c287-36b2-42ca-9f7a-9c762eb86e0a): created successfully Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06e3cf5-2bcf-492d-aeaf-f80cddfb6e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Flow 'volume_create_manager' (907790f2-e56f-4843-941b-1a5a2d5d334e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b415d84c-a38c-4481-980f-d466c854ffad tempest-VolumesCloneNegativeTest-805224326 None] Created volume successfully. Nov 03 07:43:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Acquiring lock "cinder-6698c287-36b2-42ca-9f7a-9c762eb86e0a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Lock "cinder-6698c287-36b2-42ca-9f7a-9c762eb86e0a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Acquiring lock "cinder-quobyte-6698c287-36b2-42ca-9f7a-9c762eb86e0a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Lock "cinder-quobyte-6698c287-36b2-42ca-9f7a-9c762eb86e0a" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd73b78c-5c1b-4eef-a1db-33671fe9b2d0]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:02 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a Nov 03 07:43:02 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:03 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:03 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a Nov 03 07:43:03 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:03 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6698c287-36b2-42ca-9f7a-9c762eb86e0a" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Lock "cinder-quobyte-6698c287-36b2-42ca-9f7a-9c762eb86e0a" released by "delete_volume" :: held 0.813s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Created reservations ['a34ab77c-94c3-4726-98bc-8869d22dad9e', '3a2ecf84-f554-4cb0-b822-75874ad4e116', '41068495-2598-46d7-b486-20538c8838da', '8b716f67-6191-4731-8351-b5a1a8ea15bf'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:03 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:43:03 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:04 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:04 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Deleted volume successfully. Nov 03 07:43:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-50c20935-7962-41f4-a8a9-17c0f7629bcf tempest-VolumesCloneNegativeTest-805224326 None] Lock "cinder-6698c287-36b2-42ca-9f7a-9c762eb86e0a-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Flow 'volume_create_manager' (5a3f2805-d1d3-4c0d-9eb7-bd3cba988c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80082630-1461-4760-8e8c-da56f9ec9733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80082630-1461-4760-8e8c-da56f9ec9733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1332708268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d5d543-8b9e-476d-bebe-a99215ccbdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9ab18dc842d4b5a28aa50e695bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:10Z,use_quota=True,user_id='05d6bba52b85441d897c68215762637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495f527a-b832-4255-b58e-d4be0a06289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495f527a-b832-4255-b58e-d4be0a06289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5ee2c8-7d63-4e14-b048-0ec533ece15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5ee2c8-7d63-4e14-b048-0ec533ece15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d5d543-8b9e-476d-bebe-a99215ccbdec', 'volume_name': 'volume-27d5d543-8b9e-476d-bebe-a99215ccbdec', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af8e6e-7629-4d89-94a7-dcbba6ef4b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af8e6e-7629-4d89-94a7-dcbba6ef4b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e164491b-9c2d-4e43-870d-1d3112d1d637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Volume 27d5d543-8b9e-476d-bebe-a99215ccbdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d5d543-8b9e-476d-bebe-a99215ccbdec', 'volume_size': 1} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1332708268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d5d543-8b9e-476d-bebe-a99215ccbdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9ab18dc842d4b5a28aa50e695bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:10Z,use_quota=True,user_id='05d6bba52b85441d897c68215762637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Creating volume 27d5d543-8b9e-476d-bebe-a99215ccbdec {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:43:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:09 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec 1073741824 Nov 03 07:43:09 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Flow 'volume_create_manager' (8fd6c62c-45b6-4994-aa6c-4ae04c007ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dff6d6-67c4-4e52-bd89-89cc6a097065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dff6d6-67c4-4e52-bd89-89cc6a097065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-408416327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2156b5ab-95e8-4353-8099-754dc4990b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9ab18dc842d4b5a28aa50e695bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:10Z,use_quota=True,user_id='05d6bba52b85441d897c68215762637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15faf55b-0488-403a-bca5-69ac864cd8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15faf55b-0488-403a-bca5-69ac864cd8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657d2508-d1be-4104-851a-0c0475058c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657d2508-d1be-4104-851a-0c0475058c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2156b5ab-95e8-4353-8099-754dc4990b41', 'volume_name': 'volume-2156b5ab-95e8-4353-8099-754dc4990b41', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb29c6cb-398d-49c0-98b8-fd14a876a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb29c6cb-398d-49c0-98b8-fd14a876a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a68794b-c7e0-4863-bc61-241dec2d0460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Volume 2156b5ab-95e8-4353-8099-754dc4990b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2156b5ab-95e8-4353-8099-754dc4990b41', 'volume_size': 1} Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:10 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec 1073741824" returned: 0 in 0.982s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:11 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec Nov 03 07:43:11 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:11 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec" returned: 0 in 0.792s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-408416327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2156b5ab-95e8-4353-8099-754dc4990b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9ab18dc842d4b5a28aa50e695bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:10Z,use_quota=True,user_id='05d6bba52b85441d897c68215762637e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Creating volume 2156b5ab-95e8-4353-8099-754dc4990b41 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e164491b-9c2d-4e43-870d-1d3112d1d637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d5d543-8b9e-476d-bebe-a99215ccbdec', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4571c1b-2723-47b3-a28c-de2206d89bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:12 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 1073741824 Nov 03 07:43:12 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Volume volume-27d5d543-8b9e-476d-bebe-a99215ccbdec (27d5d543-8b9e-476d-bebe-a99215ccbdec): created successfully Nov 03 07:43:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4571c1b-2723-47b3-a28c-de2206d89bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Flow 'volume_create_manager' (5a3f2805-d1d3-4c0d-9eb7-bd3cba988c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-760188a5-2f55-4c2c-b809-322bbcc4cb0d tempest-TestServerVolumeAttachmentScenario-613031806 None] Created volume successfully. Nov 03 07:43:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-00861817-86eb-4d33-a03b-21030b39486b req-3433e10c-acee-409f-8b7f-ee04b1964858 tempest-TestShelveInstance-258390742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:12 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 1073741824" returned: 0 in 0.939s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:12 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 Nov 03 07:43:12 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:13 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-00861817-86eb-4d33-a03b-21030b39486b req-3433e10c-acee-409f-8b7f-ee04b1964858 tempest-TestShelveInstance-258390742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.202s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a68794b-c7e0-4863-bc61-241dec2d0460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2156b5ab-95e8-4353-8099-754dc4990b41', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ddef3b-0afd-4f0d-b279-4c64378425d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-00861817-86eb-4d33-a03b-21030b39486b req-3433e10c-acee-409f-8b7f-ee04b1964858 tempest-TestShelveInstance-258390742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Volume volume-2156b5ab-95e8-4353-8099-754dc4990b41 (2156b5ab-95e8-4353-8099-754dc4990b41): created successfully Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ddef3b-0afd-4f0d-b279-4c64378425d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Flow 'volume_create_manager' (8fd6c62c-45b6-4994-aa6c-4ae04c007ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1f72a39b-c6a2-442a-b913-1b1ca880fc9b tempest-TestServerVolumeAttachmentScenario-613031806 None] Created volume successfully. Nov 03 07:43:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-00861817-86eb-4d33-a03b-21030b39486b req-3433e10c-acee-409f-8b7f-ee04b1964858 tempest-TestShelveInstance-258390742 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24616adf-92a9-4282-9056-da85122ec473', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:43:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-00861817-86eb-4d33-a03b-21030b39486b req-3433e10c-acee-409f-8b7f-ee04b1964858 tempest-TestShelveInstance-258390742 None] attachment_update completed successfully. Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad5d1c9c-4b6b-467a-ad06-3d87a5bcf43f tempest-VolumesActionsTest-1445225575 None] Acquiring lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad5d1c9c-4b6b-467a-ad06-3d87a5bcf43f tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0" acquired by "attach_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad5d1c9c-4b6b-467a-ad06-3d87a5bcf43f tempest-VolumesActionsTest-1445225575 None] Attaching volume a5185bed-cb21-444e-9d80-da7bd6dd50b0 to instance a45dab86-d528-49e1-ad65-dca36e6d5ece at mountpoint /dev/vdb on host None. Nov 03 07:43:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad5d1c9c-4b6b-467a-ad06-3d87a5bcf43f tempest-VolumesActionsTest-1445225575 None] Attach volume completed successfully. Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad5d1c9c-4b6b-467a-ad06-3d87a5bcf43f tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0" released by "attach_volume" :: held 0.192s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Flow 'volume_create_manager' (f2d8a4d8-0610-4dba-a5ac-0097ce27d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7599c1db-f9f1-49e1-980c-9516d9afb8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7599c1db-f9f1-49e1-980c-9516d9afb8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1731948474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f03544f-d377-4bce-a4cb-2b8c778355f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ca57e3f7824b51aab9d992f42f4100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:14Z,use_quota=True,user_id='29c78a088c98484c93acaf864eef0843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4702753f-f45a-4852-b0ed-bec055f7cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4702753f-f45a-4852-b0ed-bec055f7cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a7ad34-3ee7-4ab8-a36d-5c1d643b20d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f473d8f-d5f7-4717-8929-b0863ce5430c tempest-VolumesActionsTest-1445225575 None] Acquiring lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f473d8f-d5f7-4717-8929-b0863ce5430c tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f473d8f-d5f7-4717-8929-b0863ce5430c tempest-VolumesActionsTest-1445225575 None] Detaching volume a5185bed-cb21-444e-9d80-da7bd6dd50b0 from instance a45dab86-d528-49e1-ad65-dca36e6d5ece. Nov 03 07:43:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f473d8f-d5f7-4717-8929-b0863ce5430c tempest-VolumesActionsTest-1445225575 None] Detach volume completed successfully. Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f473d8f-d5f7-4717-8929-b0863ce5430c tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-detach_volume" released by "detach_volume" :: held 0.159s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a7ad34-3ee7-4ab8-a36d-5c1d643b20d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f03544f-d377-4bce-a4cb-2b8c778355f5', 'volume_name': 'volume-0f03544f-d377-4bce-a4cb-2b8c778355f5', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9780b6-3c99-4a3f-bb32-dfdc5cf672eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9780b6-3c99-4a3f-bb32-dfdc5cf672eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b50518-de6a-4cc5-8f09-33eb9cceded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Volume 0f03544f-d377-4bce-a4cb-2b8c778355f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f03544f-d377-4bce-a4cb-2b8c778355f5', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Trying to clone 0f03544f-d377-4bce-a4cb-2b8c778355f5 from image 4c501e6d-7c58-4118-a8ef-07458ac1339d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:43:15 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f90b6-86f0-47f2-a96b-df4d33a5922f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:16 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD Nov 03 07:43:16 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:16 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d is fetched for user 29c78a088c98484c93acaf864eef0843. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f04a3-3a78-4d16-8c9c-3ca4151c480f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:16 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD Nov 03 07:43:16 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:16 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1731948474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f03544f-d377-4bce-a4cb-2b8c778355f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ca57e3f7824b51aab9d992f42f4100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:14Z,use_quota=True,user_id='29c78a088c98484c93acaf864eef0843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Creating volume 0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:43:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:16 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 1073741824 Nov 03 07:43:16 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:17 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 1073741824" returned: 0 in 0.673s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:17 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 Nov 03 07:43:17 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:18 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Attempting download of 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 0f03544f-d377-4bce-a4cb-2b8c778355f5. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5fc4c6-5998-4534-a806-3dd1ad200c33]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:18 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b Nov 03 07:43:18 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:18 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:18 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b Nov 03 07:43:18 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:19 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b" returned: 1 in 0.676s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c501e6d-7c58-4118-a8ef-07458ac1339d_tdo0064b' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:43:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7921eec9-8baa-480d-81dc-edbbb23db4a6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:19 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD Nov 03 07:43:19 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:20 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD" returned: 0 in 0.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:20 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] 4c501e6d-7c58-4118-a8ef-07458ac1339d was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:43:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:20 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 Nov 03 07:43:20 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:23 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5" returned: 0 in 3.690s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:23 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c501e6d-7c58-4118-a8ef-07458ac1339d_kiyrk709devstack@QuobyteHD, size 112.00 MB, duration 3.69 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:43:23 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Converted 112.00 MB image at 30.32 MB/s Nov 03 07:43:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:23 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 1G Nov 03 07:43:23 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:24 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 1G" returned: 0 in 0.892s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:24 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Downloaded image 4c501e6d-7c58-4118-a8ef-07458ac1339d ((None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}])) to volume 0f03544f-d377-4bce-a4cb-2b8c778355f5 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:43:24 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Temporary image 4c501e6d-7c58-4118-a8ef-07458ac1339d for user 29c78a088c98484c93acaf864eef0843 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:43:24 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Marking volume 0f03544f-d377-4bce-a4cb-2b8c778355f5 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:43:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Copying metadata from image 4c501e6d-7c58-4118-a8ef-07458ac1339d to 0f03544f-d377-4bce-a4cb-2b8c778355f5. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:43:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Creating volume glance metadata for volume 0f03544f-d377-4bce-a4cb-2b8c778355f5 backed by image 4c501e6d-7c58-4118-a8ef-07458ac1339d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:43:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b50518-de6a-4cc5-8f09-33eb9cceded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f03544f-d377-4bce-a4cb-2b8c778355f5', 'volume_size': 1, 'image_id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c501e6d-7c58-4118-a8ef-07458ac1339d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aec5878a230640f4840933795119197f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4c501e6d-7c58-4118-a8ef-07458ac1339d', 'created_at': datetime.datetime(2026, 11, 3, 6, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c501e6d-7c58-4118-a8ef-07458ac1339d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9cbe54-4c1a-4be6-8f7f-8a4ce0c8d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Volume volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 (0f03544f-d377-4bce-a4cb-2b8c778355f5): created successfully Nov 03 07:43:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9cbe54-4c1a-4be6-8f7f-8a4ce0c8d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Flow 'volume_create_manager' (f2d8a4d8-0610-4dba-a5ac-0097ce27d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ac96c354-7059-4a99-8acf-8ecabbce4ab6 tempest-VolumesExtendTest-268837731 None] Created volume successfully. Nov 03 07:43:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bcbe3e-249e-4dcb-85ee-f92e4392d9fb]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:26 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 Nov 03 07:43:26 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:26 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5" returned: 0 in 0.781s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 2G" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.086s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2a969d3f-4cb3-494c-aabb-f825dc069ece tempest-VolumesExtendTest-268837731 None] Extend volume completed successfully. Nov 03 07:43:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-0f03544f-d377-4bce-a4cb-2b8c778355f5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Lock "cinder-0f03544f-d377-4bce-a4cb-2b8c778355f5-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-quobyte-0f03544f-d377-4bce-a4cb-2b8c778355f5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-0f03544f-d377-4bce-a4cb-2b8c778355f5" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[112f4852-46a2-4907-9ddd-719231a700f4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:29 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 Nov 03 07:43:29 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:30 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5" returned: 0 in 0.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:30 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5 Nov 03 07:43:30 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:30 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0f03544f-d377-4bce-a4cb-2b8c778355f5" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-0f03544f-d377-4bce-a4cb-2b8c778355f5" released by "delete_volume" :: held 1.189s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Created reservations ['d433974c-005d-44d6-84b8-9feada45e7eb', 'e969c587-0564-44a7-bd7d-d5c6a78211bb', '1ffab97f-0a59-41d9-a57b-8286f0393bcf', 'b923bb84-538f-43ad-af12-fdd58348035b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:30 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:43:30 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:31 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.950s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Deleted volume successfully. Nov 03 07:43:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebfe3eaa-0ed3-4dc0-bb0a-ebb4f034cf2c tempest-VolumesExtendTest-268837731 None] Lock "cinder-0f03544f-d377-4bce-a4cb-2b8c778355f5-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Flow 'volume_create_manager' (6bd2c189-0657-410d-ad48-79fe988569c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae71cf5-3287-4112-b1e0-97b001cc7226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae71cf5-3287-4112-b1e0-97b001cc7226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1663080386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3282e724-6a07-4b95-8a1d-62e22b5bbc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ca57e3f7824b51aab9d992f42f4100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:33Z,use_quota=True,user_id='29c78a088c98484c93acaf864eef0843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e0fd4e-67df-4f12-9424-26518eb274a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e0fd4e-67df-4f12-9424-26518eb274a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c45379-90d2-4281-932b-ada9e86c1e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c45379-90d2-4281-932b-ada9e86c1e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3282e724-6a07-4b95-8a1d-62e22b5bbc3a', 'volume_name': 'volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ac1ab0-d1a0-4363-8d7f-cc798fef91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ac1ab0-d1a0-4363-8d7f-cc798fef91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ec42c6-5b24-47e2-b496-160e2fe4a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Volume 3282e724-6a07-4b95-8a1d-62e22b5bbc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a', 'volume_size': 1} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1663080386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3282e724-6a07-4b95-8a1d-62e22b5bbc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ca57e3f7824b51aab9d992f42f4100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:33Z,use_quota=True,user_id='29c78a088c98484c93acaf864eef0843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Creating volume 3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:43:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:33 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a 1073741824 Nov 03 07:43:33 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:34 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a 1073741824" returned: 0 in 1.104s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:35 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a Nov 03 07:43:35 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:35 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ec42c6-5b24-47e2-b496-160e2fe4a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1d9905-0c92-4e5b-a834-f756575e1e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Volume volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a (3282e724-6a07-4b95-8a1d-62e22b5bbc3a): created successfully Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1d9905-0c92-4e5b-a834-f756575e1e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Flow 'volume_create_manager' (6bd2c189-0657-410d-ad48-79fe988569c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-34260816-a4c7-4160-b7d5-3b33606f514f tempest-VolumesExtendTest-268837731 None] Created volume successfully. Nov 03 07:43:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Creating offline snapshot 21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c of volume 3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf6013-19d8-41d3-9bcc-f8fc4f3c45c7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee1d584e-c166-47fb-82ba-c66acc658674 tempest-VolumesActionsTest-1445225575 None] Acquiring lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee1d584e-c166-47fb-82ba-c66acc658674 tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0" acquired by "attach_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:37 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a Nov 03 07:43:37 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ee1d584e-c166-47fb-82ba-c66acc658674 tempest-VolumesActionsTest-1445225575 None] Attaching volume a5185bed-cb21-444e-9d80-da7bd6dd50b0 to instance e22117ae-b047-48fe-ad38-17ac4f7b7a04 at mountpoint /dev/vdb on host None. Nov 03 07:43:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ee1d584e-c166-47fb-82ba-c66acc658674 tempest-VolumesActionsTest-1445225575 None] Attach volume completed successfully. Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee1d584e-c166-47fb-82ba-c66acc658674 tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0" released by "attach_volume" :: held 0.192s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:37 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:37 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c 1G Nov 03 07:43:37 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2e5b502d-cf67-4c90-bffd-f776ade7bfb4 tempest-VolumesActionsTest-1445225575 None] Acquiring lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2e5b502d-cf67-4c90-bffd-f776ade7bfb4 tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2e5b502d-cf67-4c90-bffd-f776ade7bfb4 tempest-VolumesActionsTest-1445225575 None] Detaching volume a5185bed-cb21-444e-9d80-da7bd6dd50b0 from instance e22117ae-b047-48fe-ad38-17ac4f7b7a04. Nov 03 07:43:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2e5b502d-cf67-4c90-bffd-f776ade7bfb4 tempest-VolumesActionsTest-1445225575 None] Detach volume completed successfully. Nov 03 07:43:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2e5b502d-cf67-4c90-bffd-f776ade7bfb4 tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:38 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c 1G" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:38 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c Nov 03 07:43:38 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:39 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" returned: 0 in 0.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:39 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c is being set with open permissions: ugo+rw Nov 03 07:43:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:39 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c Nov 03 07:43:39 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:39 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" returned: 0 in 0.594s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:39 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info Nov 03 07:43:39 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:40 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info is being set with open permissions: ugo+rw Nov 03 07:43:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:40 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info Nov 03 07:43:40 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:40 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.info" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.770s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b794ecf4-7575-4782-a080-39dccc364b0f tempest-VolumesExtendTest-268837731 None] Create snapshot completed successfully Nov 03 07:43:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b591746d-8543-4083-8163-108631367153]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:41 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a Nov 03 07:43:41 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:41 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c 2G" returned: 0 in 0.218s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.714s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b5135bd4-f6b8-466d-8503-e091840af616 tempest-VolumesExtendTest-268837731 None] Extend volume completed successfully. Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Lock "cinder-21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-quobyte-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-quobyte-21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Deleting offline snapshot 21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c of volume 3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] snapshot_file for this snap is: volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810e843-c900-459f-b4b9-344a0719403e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:42 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c Nov 03 07:43:42 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:43 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" returned: 0 in 0.453s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22a4a5-5bde-4c56-8a45-7970b1f6e4cd]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:43 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a Nov 03 07:43:43 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:43 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:43 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c Nov 03 07:43:43 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2515cf2c-17b3-43b9-b511-980c4e0cbfd7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:43 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:43:43 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:44 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:44 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c Nov 03 07:43:44 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:44 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e3fb8-f9aa-46a4-8b11-417317e361ce]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:44 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:43:44 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:44 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a.21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c" released by "_delete_snapshot" :: held 1.736s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" released by "delete_snapshot" :: held 1.767s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Created reservations ['e6bddd7b-3a1d-4d45-89af-084087439442', '4dccba60-4a35-4117-98f8-bc091a63b549', '2150235e-5193-4782-833c-10463f0346c4', 'c0634192-ae28-44e3-8583-626b434fc7a3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Delete snapshot completed successfully. Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a661758-7096-41a7-be33-a065cd49b650 tempest-VolumesExtendTest-268837731 None] Lock "cinder-21ec4fa5-1bdb-4f9d-adbe-75d1dc1cf05c-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:44 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.060c5f17-ac75-4614-ada7-5154eae2b6d3rqwc8r_x.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:44 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.060c5f17-ac75-4614-ada7-5154eae2b6d3rqwc8r_x.img Nov 03 07:43:44 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-3282e724-6a07-4b95-8a1d-62e22b5bbc3a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Lock "cinder-3282e724-6a07-4b95-8a1d-62e22b5bbc3a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Acquiring lock "cinder-quobyte-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ed3c5-5a7b-4bd3-a16c-b42afd02cdbc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:45 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a Nov 03 07:43:45 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:45 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" returned: 0 in 0.586s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:46 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a Nov 03 07:43:46 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:46 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Lock "cinder-quobyte-3282e724-6a07-4b95-8a1d-62e22b5bbc3a" released by "delete_volume" :: held 1.097s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Created reservations ['5d6a3da5-4953-4798-82e2-a64b9414de7d', 'dd8480cf-93cb-412a-b520-979c1755c801', '2f075cb4-35ba-43c8-81ed-2e4ada7ea46a', '0a073891-5ca3-4816-8ca2-4568a6fb7d81'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:46 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:43:46 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:47 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.538s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:47 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Deleted volume successfully. Nov 03 07:43:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96720692-a1e2-43aa-bbe8-fd05ce104afb tempest-VolumesExtendTest-268837731 None] Lock "cinder-3282e724-6a07-4b95-8a1d-62e22b5bbc3a-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:52 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.060c5f17-ac75-4614-ada7-5154eae2b6d3rqwc8r_x.img" returned: 0 in 7.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f64fa1-e9e1-4697-a1fa-ac3bf3901095]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:52 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:43:52 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:52 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.613s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:52 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.060c5f17-ac75-4614-ada7-5154eae2b6d3rqwc8r_x.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:43:52 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Converted 1024.00 MB image at 134.34 MB/s Nov 03 07:43:53 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=68,cinder:UPDATE=70,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:53 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=69,cinder:UPDATE=56,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:53 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] 060c5f17-ac75-4614-ada7-5154eae2b6d3 was raw, no need to convert to raw {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Flow 'volume_create_manager' (e0381b9b-3366-45bc-90ba-ef045142cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb0c935-3a4c-4919-9b4e-9e6d9ab017ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb0c935-3a4c-4919-9b4e-9e6d9ab017ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1639953321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b26011-8650-4e26-8c19-450fe595a2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c86e8dd668646beb992dc6f48c8e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:54Z,use_quota=True,user_id='84f770a5eab744159eed385084f3a39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1c10b8-d25f-4fef-9ab7-0bf61ea43a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1c10b8-d25f-4fef-9ab7-0bf61ea43a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f81f45-51bd-41cf-9df2-7ac3a9b3b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f81f45-51bd-41cf-9df2-7ac3a9b3b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b26011-8650-4e26-8c19-450fe595a2b1', 'volume_name': 'volume-b8b26011-8650-4e26-8c19-450fe595a2b1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2c3a7a-8d54-44c1-a96d-66c79abcc907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2c3a7a-8d54-44c1-a96d-66c79abcc907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fa168c-cedf-47e0-a06b-563a92a4e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Volume b8b26011-8650-4e26-8c19-450fe595a2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b26011-8650-4e26-8c19-450fe595a2b1', 'volume_size': 1} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:54 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:43:54 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:54 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:43:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:43:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-56f9cd2e-2205-4561-8405-212a7fcfa173 req-e5556d9a-a34a-4ecb-905d-d2ab86e75a8b tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-26765569-75c6-4d3a-98bc-ba564ef54f61 tempest-TestShelveInstance-258390742 None] Terminate volume connection completed successfully. Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-26765569-75c6-4d3a-98bc-ba564ef54f61 tempest-TestShelveInstance-258390742 None] Deleting attachment 24616adf-92a9-4282-9056-da85122ec473. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Acquiring lock "cinder-6b12f85e-4792-4bde-b7ea-c0f843f3eb59-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Lock "cinder-6b12f85e-4792-4bde-b7ea-c0f843f3eb59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Acquiring lock "cinder-quobyte-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Lock "cinder-quobyte-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa1bdb-55e6-4362-9b0e-7f1d6462e980]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:03 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 Nov 03 07:44:03 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:03 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" returned: 0 in 0.429s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:04 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59 Nov 03 07:44:04 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:04 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Lock "cinder-quobyte-6b12f85e-4792-4bde-b7ea-c0f843f3eb59" released by "delete_volume" :: held 0.900s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG cinder.quota [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Created reservations ['7a653eef-514b-4879-9c09-02f69b91bfb5', '28005086-8565-43ad-aeb9-460f190343b2', 'a73cc4b3-0ce7-47b0-bb1c-5cf1b81d7265', 'a6c59657-b3b6-489e-b095-80e40d5c9f6b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:04 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:04 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:04 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:04 devstack cinder-volume[86916]: DEBUG cinder.manager [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Deleted volume successfully. Nov 03 07:44:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-4cc1d5b0-200f-45f3-b3e8-06de26fc2693 req-1b674a69-106e-48db-beb7-117f33ccaa51 tempest-TestShelveInstance-258390742 None] Lock "cinder-6b12f85e-4792-4bde-b7ea-c0f843f3eb59-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.730s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Uploaded volume to glance image-id: 060c5f17-ac75-4614-ada7-5154eae2b6d3. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.458s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1639953321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b26011-8650-4e26-8c19-450fe595a2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c86e8dd668646beb992dc6f48c8e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:54Z,use_quota=True,user_id='84f770a5eab744159eed385084f3a39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Creating volume b8b26011-8650-4e26-8c19-450fe595a2b1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:15 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 1073741824 Nov 03 07:44:15 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-989b266c-e5b7-45e1-8489-7191f340bf6d tempest-VolumesActionsTest-1445225575 None] Copy volume to image completed successfully. Nov 03 07:44:16 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 1073741824" returned: 0 in 0.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:16 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 Nov 03 07:44:16 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:16 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-56f9cd2e-2205-4561-8405-212a7fcfa173 req-e5556d9a-a34a-4ecb-905d-d2ab86e75a8b tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.548s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fa168c-cedf-47e0-a06b-563a92a4e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b26011-8650-4e26-8c19-450fe595a2b1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76485f4d-ce48-4505-a6a4-0acb9d349da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-56f9cd2e-2205-4561-8405-212a7fcfa173 req-e5556d9a-a34a-4ecb-905d-d2ab86e75a8b tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Volume volume-b8b26011-8650-4e26-8c19-450fe595a2b1 (b8b26011-8650-4e26-8c19-450fe595a2b1): created successfully Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76485f4d-ce48-4505-a6a4-0acb9d349da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Flow 'volume_create_manager' (e0381b9b-3366-45bc-90ba-ef045142cf55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-caec522c-6750-4154-a4de-83ef409f0fab tempest-VolumesNegativeTest-2027849293 None] Created volume successfully. Nov 03 07:44:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-56f9cd2e-2205-4561-8405-212a7fcfa173 req-e5556d9a-a34a-4ecb-905d-d2ab86e75a8b tempest-TestServerVolumeAttachmentScenario-613031806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-27d5d543-8b9e-476d-bebe-a99215ccbdec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90f87a4a-0560-4eaa-83f9-bfd2849c84ef', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:44:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-56f9cd2e-2205-4561-8405-212a7fcfa173 req-e5556d9a-a34a-4ecb-905d-d2ab86e75a8b tempest-TestServerVolumeAttachmentScenario-613031806 None] attachment_update completed successfully. Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f8276-94a5-4bcd-8d8e-e3ac0b4760a8]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:18 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:44:18 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:18 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667a0a6-0c23-4509-9658-48a8fa92e8d4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:18 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:44:18 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:18 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.476s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:19 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img Nov 03 07:44:19 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (b2178277-b83f-496a-bba0-71ddd8603fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6989490d-cc15-4a85-aa3b-7c3878e6d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6989490d-cc15-4a85-aa3b-7c3878e6d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1659773581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87811877-bcd4-4a7b-943f-a54b40d518b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:23Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ddce63-d209-41f2-8c2a-8d6948408114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ddce63-d209-41f2-8c2a-8d6948408114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c60899-4e3c-48ae-9830-69c62ed8ed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c60899-4e3c-48ae-9830-69c62ed8ed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87811877-bcd4-4a7b-943f-a54b40d518b0', 'volume_name': 'volume-87811877-bcd4-4a7b-943f-a54b40d518b0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b35da6-5570-4338-aa06-0a8306e14aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b35da6-5570-4338-aa06-0a8306e14aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b02095-2862-41a2-80db-e26e63cc9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume 87811877-bcd4-4a7b-943f-a54b40d518b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87811877-bcd4-4a7b-943f-a54b40d518b0', 'volume_size': 1} Nov 03 07:44:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-56b9f73a-1961-4fa3-9808-a3f0195010ef req-03bd0ad2-203b-445d-b02b-57d54f0bbc8d tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:29 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img" returned: 0 in 10.046s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8374283-fa0f-4525-9004-e98672e11efa]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:29 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:44:29 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:29 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0, size 1024.00 MB, duration 10.05 sec, destination /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:29 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Converted 1024.00 MB image at 101.92 MB/s Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] 267d73e5-6b13-4c7d-bbe6-61aedd8f033f was raw, converting to qcow2 {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a97dd-70dc-4f11-9eea-c9c405d69971]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:29 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img Nov 03 07:44:29 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img Nov 03 07:44:30 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img" returned: 1 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq Nov 03 07:44:30 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Image conversion details: src /opt/stack/data/cinder/conversion/a5185bed-cb21-444e-9d80-da7bd6dd50b0.temp_image.267d73e5-6b13-4c7d-bbe6-61aedd8f033f7cr06mof.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:30 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792e8e9-e249-4895-a792-2392aa8d5677]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq Nov 03 07:44:30 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:31 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4jwtxaqq" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.986s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Uploaded volume to glance image-id: 267d73e5-6b13-4c7d-bbe6-61aedd8f033f. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:44:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.047s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1659773581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87811877-bcd4-4a7b-943f-a54b40d518b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:23Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating volume 87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:33 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 1073741824 Nov 03 07:44:33 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fe046aa6-df1b-4040-8ad4-b1adb7c7bd27 tempest-VolumesActionsTest-1445225575 None] Copy volume to image completed successfully. Nov 03 07:44:33 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 1073741824" returned: 0 in 0.511s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:33 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 Nov 03 07:44:33 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:33 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-56b9f73a-1961-4fa3-9808-a3f0195010ef req-03bd0ad2-203b-445d-b02b-57d54f0bbc8d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.426s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b02095-2862-41a2-80db-e26e63cc9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87811877-bcd4-4a7b-943f-a54b40d518b0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8049c0fe-8d5b-44b0-8690-f0b6b75c1597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-56b9f73a-1961-4fa3-9808-a3f0195010ef req-03bd0ad2-203b-445d-b02b-57d54f0bbc8d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume volume-87811877-bcd4-4a7b-943f-a54b40d518b0 (87811877-bcd4-4a7b-943f-a54b40d518b0): created successfully Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8049c0fe-8d5b-44b0-8690-f0b6b75c1597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (b2178277-b83f-496a-bba0-71ddd8603fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5477c869-9cb3-449c-9c16-b789450a2a55 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created volume successfully. Nov 03 07:44:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-56b9f73a-1961-4fa3-9808-a3f0195010ef req-03bd0ad2-203b-445d-b02b-57d54f0bbc8d tempest-TestServerVolumeAttachmentScenario-613031806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-2156b5ab-95e8-4353-8099-754dc4990b41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '647178af-aefe-4616-9eff-c41ce0dc7ec0', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:44:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-56b9f73a-1961-4fa3-9808-a3f0195010ef req-03bd0ad2-203b-445d-b02b-57d54f0bbc8d tempest-TestServerVolumeAttachmentScenario-613031806 None] attachment_update completed successfully. Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating offline snapshot 228e79e9-f057-424d-981b-6a759c6ebd3c of volume 87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b911aca-3847-4782-95f3-b3a381d9e6aa]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Acquiring lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:34 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 Nov 03 07:44:34 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Acquiring lock "cinder-quobyte-a5185bed-cb21-444e-9d80-da7bd6dd50b0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Lock "cinder-quobyte-a5185bed-cb21-444e-9d80-da7bd6dd50b0" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[63af70ff-f829-43bd-9a15-a677f73fde07]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:44:35 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:35 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0" returned: 0 in 0.489s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c 1G Nov 03 07:44:35 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:35 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0 Nov 03 07:44:35 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:35 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a5185bed-cb21-444e-9d80-da7bd6dd50b0" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Lock "cinder-quobyte-a5185bed-cb21-444e-9d80-da7bd6dd50b0" released by "delete_volume" :: held 0.862s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Created reservations ['783f38bb-f6bf-40dc-8819-94dfbca870db', 'd4b82f49-f011-46f5-9500-33fc4c12e714', '99635d8d-4fb4-46ff-809c-5a96602cfdc8', '464facd8-79db-43f8-bf16-7ec037bda79d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:35 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c 1G" returned: 0 in 0.607s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87811877-bcd4-4a7b-943f-a54b40d518b0 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87811877-bcd4-4a7b-943f-a54b40d518b0 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c Nov 03 07:44:35 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:36 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6054d5bd-ef7c-46ba-95ea-c02e87b856ad req-e348ff88-dac0-4f1b-90b9-3cd7fd531020 tempest-TestServerVolumeAttachmentScenario-613031806 None] Terminate volume connection completed successfully. Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6054d5bd-ef7c-46ba-95ea-c02e87b856ad req-e348ff88-dac0-4f1b-90b9-3cd7fd531020 tempest-TestServerVolumeAttachmentScenario-613031806 None] Deleting attachment 647178af-aefe-4616-9eff-c41ce0dc7ec0. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:44:36 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87811877-bcd4-4a7b-943f-a54b40d518b0 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c" returned: 0 in 0.477s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c is being set with open permissions: ugo+rw Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:36 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c Nov 03 07:44:36 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Deleted volume successfully. Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-966f87fb-84c5-4971-a56d-94e7f27a998e tempest-VolumesActionsTest-1445225575 None] Lock "cinder-a5185bed-cb21-444e-9d80-da7bd6dd50b0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:36 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c" returned: 0 in 0.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info Nov 03 07:44:36 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info is being set with open permissions: ugo+rw Nov 03 07:44:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info Nov 03 07:44:37 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.info" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.888s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-38078f23-23e8-4e99-8951-28894802fe57 tempest-CreateVolumesFromSnapshotTest-355990746 None] Create snapshot completed successfully Nov 03 07:44:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-5bf0eb79-dca2-404e-b8ab-3c09763af1a9 req-c48a9d08-8b4c-46b0-9130-50a002591785 tempest-TestServerVolumeAttachmentScenario-613031806 None] Terminate volume connection completed successfully. Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-5bf0eb79-dca2-404e-b8ab-3c09763af1a9 req-c48a9d08-8b4c-46b0-9130-50a002591785 tempest-TestServerVolumeAttachmentScenario-613031806 None] Deleting attachment 90f87a4a-0560-4eaa-83f9-bfd2849c84ef. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (4c004241-b07a-45f8-8bf3-dcdf5b9264db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c8489c-5e4a-4563-8640-cdea1d2cae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c8489c-5e4a-4563-8640-cdea1d2cae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123461951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3544c1c-d16a-4cf4-8119-b5191de7549f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:39Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c28c87-1762-46fd-a183-d2d8927318de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c28c87-1762-46fd-a183-d2d8927318de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b3507f-ecc3-4803-986b-f43f74a474bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b3507f-ecc3-4803-986b-f43f74a474bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3544c1c-d16a-4cf4-8119-b5191de7549f', 'volume_name': 'volume-c3544c1c-d16a-4cf4-8119-b5191de7549f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d257ba27-8039-461e-b12b-ab407a2f58bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d257ba27-8039-461e-b12b-ab407a2f58bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3843b799-eb75-40e3-b8c0-76fb5fd68a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume c3544c1c-d16a-4cf4-8119-b5191de7549f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3544c1c-d16a-4cf4-8119-b5191de7549f', 'volume_size': 1} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123461951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3544c1c-d16a-4cf4-8119-b5191de7549f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:39Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating volume c3544c1c-d16a-4cf4-8119-b5191de7549f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:38 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:38 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f 1073741824 Nov 03 07:44:38 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (e7d1bb1d-13d7-4d74-aef3-6e479548d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b1fcfe-9a55-4d5b-bd79-9e6c4384ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b1fcfe-9a55-4d5b-bd79-9e6c4384ff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466039057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dafa90-2992-49bb-9866-c7f1a5cf5d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:39Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86755dc2-c208-4450-bbb4-25f35cc54ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86755dc2-c208-4450-bbb4-25f35cc54ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1d341b-c0ca-43e8-b177-7ee9e2550c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1d341b-c0ca-43e8-b177-7ee9e2550c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2dafa90-2992-49bb-9866-c7f1a5cf5d75', 'volume_name': 'volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850f864b-ed9d-4bf3-a7b5-e4972be40c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850f864b-ed9d-4bf3-a7b5-e4972be40c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf9e9c1-24a0-4208-baf4-0e0704c9b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume c2dafa90-2992-49bb-9866-c7f1a5cf5d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75', 'volume_size': 1} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:39 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f 1073741824" returned: 0 in 0.846s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:39 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f Nov 03 07:44:39 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (e9440074-0b87-4532-a95a-538f79a91d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cb73cb-557e-4cb0-994e-ed0e71ad036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cb73cb-557e-4cb0-994e-ed0e71ad036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257217931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb4146-5559-44cc-8eb2-4859ee460443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:40Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa8b5f5-31a0-4057-9741-f4938d57a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa8b5f5-31a0-4057-9741-f4938d57a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba58e6a1-03bc-49b7-a437-86559cbfd0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba58e6a1-03bc-49b7-a437-86559cbfd0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bb4146-5559-44cc-8eb2-4859ee460443', 'volume_name': 'volume-87bb4146-5559-44cc-8eb2-4859ee460443', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634ff44f-0e9d-4d0b-b44d-4587f481cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634ff44f-0e9d-4d0b-b44d-4587f481cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3695723-21c2-42bc-b7c6-37d38b04f9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume 87bb4146-5559-44cc-8eb2-4859ee460443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bb4146-5559-44cc-8eb2-4859ee460443', 'volume_size': 1} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f" returned: 0 in 0.698s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466039057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dafa90-2992-49bb-9866-c7f1a5cf5d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:39Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating volume c2dafa90-2992-49bb-9866-c7f1a5cf5d75 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3843b799-eb75-40e3-b8c0-76fb5fd68a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3544c1c-d16a-4cf4-8119-b5191de7549f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b599443b-d108-41d3-8616-df0ed63cf79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 1073741824 Nov 03 07:44:40 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume volume-c3544c1c-d16a-4cf4-8119-b5191de7549f (c3544c1c-d16a-4cf4-8119-b5191de7549f): created successfully Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b599443b-d108-41d3-8616-df0ed63cf79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (4c004241-b07a-45f8-8bf3-dcdf5b9264db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-187a1ed1-8c77-4591-bf52-6a90622c293f tempest-CreateVolumesFromSnapshotTest-355990746 None] Created volume successfully. Nov 03 07:44:41 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 1073741824" returned: 0 in 0.825s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:41 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 Nov 03 07:44:41 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (f9dc4e97-8cf6-4366-9cb8-44f93985739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c9946e-0c3a-4892-b3ee-376595deaf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c9946e-0c3a-4892-b3ee-376595deaf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801315548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e5162f-5021-4cf3-ad3b-ddd6701027ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:41Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561c0401-8f65-45db-adcb-fa5a56104a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561c0401-8f65-45db-adcb-fa5a56104a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ce5353-3d74-4a5c-b885-8042e7c29da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ce5353-3d74-4a5c-b885-8042e7c29da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e5162f-5021-4cf3-ad3b-ddd6701027ee', 'volume_name': 'volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911c345b-e3d9-4d20-9a04-d289c16b0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911c345b-e3d9-4d20-9a04-d289c16b0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760360e0-7b71-4228-87e3-9d05adb50380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume 40e5162f-5021-4cf3-ad3b-ddd6701027ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee', 'volume_size': 1} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:41 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257217931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb4146-5559-44cc-8eb2-4859ee460443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:40Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating volume 87bb4146-5559-44cc-8eb2-4859ee460443 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf9e9c1-24a0-4208-baf4-0e0704c9b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:41 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 1073741824 Nov 03 07:44:41 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0505b9d4-7d43-4812-9dad-4d9d2a8d0c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 (c2dafa90-2992-49bb-9866-c7f1a5cf5d75): created successfully Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0505b9d4-7d43-4812-9dad-4d9d2a8d0c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (e7d1bb1d-13d7-4d74-aef3-6e479548d5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e7f312c6-0745-4eca-9be8-db97b5ac2043 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created volume successfully. Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (ea04fc0c-5405-4114-a48d-4a80104c7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9028bf45-b182-4be5-8514-78d4752a4026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9028bf45-b182-4be5-8514-78d4752a4026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334290159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f546dc5-4cd9-46c4-b092-e68f4735dbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:42Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccc0c52-8d2a-4f27-ac1f-b89c6f6940b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccc0c52-8d2a-4f27-ac1f-b89c6f6940b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69dcfb-9f00-4c65-a9ba-8a4436186b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69dcfb-9f00-4c65-a9ba-8a4436186b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f546dc5-4cd9-46c4-b092-e68f4735dbf2', 'volume_name': 'volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75aeaab0-53cc-4153-9ec8-6d0ca01a7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75aeaab0-53cc-4153-9ec8-6d0ca01a7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db113ee-344c-4574-b6fb-956324984e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume 8f546dc5-4cd9-46c4-b092-e68f4735dbf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2', 'volume_size': 1} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:42 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 1073741824" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:42 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 Nov 03 07:44:42 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:43 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801315548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e5162f-5021-4cf3-ad3b-ddd6701027ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:41Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating volume 40e5162f-5021-4cf3-ad3b-ddd6701027ee {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:43 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee 1073741824 Nov 03 07:44:43 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3695723-21c2-42bc-b7c6-37d38b04f9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bb4146-5559-44cc-8eb2-4859ee460443', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2625c7ad-d317-4558-973d-1b88199b8e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume volume-87bb4146-5559-44cc-8eb2-4859ee460443 (87bb4146-5559-44cc-8eb2-4859ee460443): created successfully Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2625c7ad-d317-4558-973d-1b88199b8e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (e9440074-0b87-4532-a95a-538f79a91d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5b622338-a31e-463b-b527-ab0c37adf86d tempest-CreateVolumesFromSnapshotTest-355990746 None] Created volume successfully. Nov 03 07:44:43 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee 1073741824" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:44 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee Nov 03 07:44:44 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:44 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee" returned: 0 in 0.472s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334290159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f546dc5-4cd9-46c4-b092-e68f4735dbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32ab53d8f1748d7903e71638ee602dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:42Z,use_quota=True,user_id='121cef418b494705a1ee564d3cd8ac3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Creating volume 8f546dc5-4cd9-46c4-b092-e68f4735dbf2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:44 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 1073741824 Nov 03 07:44:44 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760360e0-7b71-4228-87e3-9d05adb50380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4e2002-3da5-4937-aaac-33ae452f9101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee (40e5162f-5021-4cf3-ad3b-ddd6701027ee): created successfully Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4e2002-3da5-4937-aaac-33ae452f9101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (f9dc4e97-8cf6-4366-9cb8-44f93985739c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Acquiring lock "cinder-b8b26011-8650-4e26-8c19-450fe595a2b1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5967f2e1-72fc-4baa-b39b-e61a586d5bcf tempest-CreateVolumesFromSnapshotTest-355990746 None] Created volume successfully. Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Lock "cinder-b8b26011-8650-4e26-8c19-450fe595a2b1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Acquiring lock "cinder-quobyte-b8b26011-8650-4e26-8c19-450fe595a2b1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Lock "cinder-quobyte-b8b26011-8650-4e26-8c19-450fe595a2b1" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7fca40-6636-45eb-94a2-df1b3c7ddf27]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:44 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 Nov 03 07:44:44 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:45 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 1073741824" returned: 0 in 0.657s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:45 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 Nov 03 07:44:45 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:45 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1" returned: 0 in 0.581s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:45 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1 Nov 03 07:44:45 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:45 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db113ee-344c-4574-b6fb-956324984e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd21084-5498-4be7-9b2f-ff67f729b464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Volume volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 (8f546dc5-4cd9-46c4-b092-e68f4735dbf2): created successfully Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd21084-5498-4be7-9b2f-ff67f729b464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Flow 'volume_create_manager' (ea04fc0c-5405-4114-a48d-4a80104c7893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ceb382aa-4110-49d9-b103-f0bcfe7227d3 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created volume successfully. Nov 03 07:44:45 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b8b26011-8650-4e26-8c19-450fe595a2b1" returned: 0 in 0.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Lock "cinder-quobyte-b8b26011-8650-4e26-8c19-450fe595a2b1" released by "delete_volume" :: held 1.078s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Created reservations ['2e827817-f18f-4392-808e-0fc831039427', '9c27b451-0269-4a79-b6dd-9bb871f9c2c0', '88c371e8-6485-4b47-ae7f-5935c1592ed2', '6abe04b4-34e1-46ec-99bf-c7e1066c18e2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:46 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "cinder-2156b5ab-95e8-4353-8099-754dc4990b41-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-2156b5ab-95e8-4353-8099-754dc4990b41-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "cinder-quobyte-2156b5ab-95e8-4353-8099-754dc4990b41" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-quobyte-2156b5ab-95e8-4353-8099-754dc4990b41" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced0381-68b8-49a8-8aab-ac2e1e77ab39]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:46 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 Nov 03 07:44:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Deleted volume successfully. Nov 03 07:44:46 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5de00878-38da-46fd-bbd2-81e244338ca8 tempest-VolumesNegativeTest-2027849293 None] Lock "cinder-b8b26011-8650-4e26-8c19-450fe595a2b1-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:46 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41 Nov 03 07:44:46 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2156b5ab-95e8-4353-8099-754dc4990b41" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-quobyte-2156b5ab-95e8-4353-8099-754dc4990b41" released by "delete_volume" :: held 0.777s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-8f546dc5-4cd9-46c4-b092-e68f4735dbf2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Created reservations ['f30a2d68-8f78-4bfb-9388-96bb296b8b1f', 'ceefa952-86d0-42ba-bed6-d56b9da4aa35', 'dd2bdf7b-5e26-4a6d-8086-2073b5620dc1', '59a13118-e294-405f-be0f-f7e4dcff1da4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-8f546dc5-4cd9-46c4-b092-e68f4735dbf2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-8f546dc5-4cd9-46c4-b092-e68f4735dbf2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-8f546dc5-4cd9-46c4-b092-e68f4735dbf2" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc4cb4-444b-41a2-92ca-3efcbbd0fe22]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "cinder-27d5d543-8b9e-476d-bebe-a99215ccbdec-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:47 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:47 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-27d5d543-8b9e-476d-bebe-a99215ccbdec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:47 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 Nov 03 07:44:47 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "cinder-quobyte-27d5d543-8b9e-476d-bebe-a99215ccbdec" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-quobyte-27d5d543-8b9e-476d-bebe-a99215ccbdec" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be08e0-ae0f-47fc-8bab-eb23046de36b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec Nov 03 07:44:47 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:47 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2" returned: 0 in 0.565s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Deleted volume successfully. Nov 03 07:44:47 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2 Nov 03 07:44:47 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d730ef3-4644-438d-930c-07e3ec6677e0 tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-2156b5ab-95e8-4353-8099-754dc4990b41-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec" returned: 0 in 0.525s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec Nov 03 07:44:48 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8f546dc5-4cd9-46c4-b092-e68f4735dbf2" returned: 0 in 0.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-8f546dc5-4cd9-46c4-b092-e68f4735dbf2" released by "delete_volume" :: held 1.028s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['a751d628-229c-4f11-8426-041043004b7c', 'a901b4cf-62f5-4465-853a-b5c01bccc355', 'fafcd26e-286e-426d-8b17-1bbace064d39', 'acb123bc-62ed-47f8-8735-2cae08203a2d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-27d5d543-8b9e-476d-bebe-a99215ccbdec" returned: 0 in 0.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:48 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-quobyte-27d5d543-8b9e-476d-bebe-a99215ccbdec" released by "delete_volume" :: held 0.953s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Created reservations ['82b5454c-c5c4-4652-b526-1f52a0fa3ed4', '8bbdd392-2566-45d5-9169-a3f2ccea5f6c', 'bfa1803b-3ae4-49ec-87d0-cd2d8b1a41f7', '945c8514-ecf8-4007-b554-8abb8840ca33'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:48 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleted volume successfully. Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-532d6b00-1102-469a-b863-2680ce7de361 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-8f546dc5-4cd9-46c4-b092-e68f4735dbf2-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Deleted volume successfully. Nov 03 07:44:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a1ae666-9726-4274-a1b2-13e08222d13d tempest-TestServerVolumeAttachmentScenario-613031806 None] Lock "cinder-27d5d543-8b9e-476d-bebe-a99215ccbdec-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-40e5162f-5021-4cf3-ad3b-ddd6701027ee-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-40e5162f-5021-4cf3-ad3b-ddd6701027ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Flow 'volume_create_manager' (e4047b27-4646-4bcf-9ab8-1a8052e054d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64702860-d9bd-470a-8727-80ca15202611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64702860-d9bd-470a-8727-80ca15202611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1156784772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ff039f-2f04-492a-9593-18ec0ce91457,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8414e04fb144018a8109386e4225c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:49Z,use_quota=True,user_id='2c6f3324213d447c81cf6e806a53d4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e299257-180f-40a2-950b-140a3ee505a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e299257-180f-40a2-950b-140a3ee505a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f5657f-0050-4001-8cbd-52f0b4b8b0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f5657f-0050-4001-8cbd-52f0b4b8b0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ff039f-2f04-492a-9593-18ec0ce91457', 'volume_name': 'volume-f9ff039f-2f04-492a-9593-18ec0ce91457', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b26176-a258-4476-a68f-53abaf1dfa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b26176-a258-4476-a68f-53abaf1dfa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0995dc37-8ef7-49f9-91a8-4ee6f4cb65d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Volume f9ff039f-2f04-492a-9593-18ec0ce91457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ff039f-2f04-492a-9593-18ec0ce91457', 'volume_size': 1} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1156784772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ff039f-2f04-492a-9593-18ec0ce91457,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8414e04fb144018a8109386e4225c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:49Z,use_quota=True,user_id='2c6f3324213d447c81cf6e806a53d4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Creating volume f9ff039f-2f04-492a-9593-18ec0ce91457 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 1073741824 Nov 03 07:44:49 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-40e5162f-5021-4cf3-ad3b-ddd6701027ee" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-40e5162f-5021-4cf3-ad3b-ddd6701027ee" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9a43a-ea5a-4ee8-9a1b-d775796f1b96]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee Nov 03 07:44:49 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee" returned: 0 in 0.466s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:50 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee Nov 03 07:44:50 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 1073741824" returned: 0 in 0.630s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:50 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 Nov 03 07:44:50 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-40e5162f-5021-4cf3-ad3b-ddd6701027ee" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-40e5162f-5021-4cf3-ad3b-ddd6701027ee" released by "delete_volume" :: held 0.933s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['eef40ed4-b4d3-4b56-a27c-5983b2a52f63', '8be8ca6f-6d2a-43de-96c5-eea6fce23bd3', '0401b7c1-2b0d-4114-bdc9-617fbed1dc23', '2a083e63-7803-4883-a9a8-393f125c15e2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:50 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0995dc37-8ef7-49f9-91a8-4ee6f4cb65d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ff039f-2f04-492a-9593-18ec0ce91457', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b290337b-5dc9-4f29-a26a-c2cb6df31072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Volume volume-f9ff039f-2f04-492a-9593-18ec0ce91457 (f9ff039f-2f04-492a-9593-18ec0ce91457): created successfully Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b290337b-5dc9-4f29-a26a-c2cb6df31072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Flow 'volume_create_manager' (e4047b27-4646-4bcf-9ab8-1a8052e054d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-477253d4-f0ed-4188-95ba-c0daf5f55174 tempest-VolumesListTestJSON-1561798033 None] Created volume successfully. Nov 03 07:44:50 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:50 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:51 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleted volume successfully. Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2a474b3-c0f9-4adb-b4ea-4dc9eb081707 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-40e5162f-5021-4cf3-ad3b-ddd6701027ee-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-87bb4146-5559-44cc-8eb2-4859ee460443-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-87bb4146-5559-44cc-8eb2-4859ee460443-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-87bb4146-5559-44cc-8eb2-4859ee460443" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-87bb4146-5559-44cc-8eb2-4859ee460443" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a79cf4e-f096-40cb-a0b1-a2b3642af142]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Flow 'volume_create_manager' (bd153b1c-4dc4-464c-a98a-ee712cfea4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632675c2-5c4a-45d7-9818-cf3e13783866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632675c2-5c4a-45d7-9818-cf3e13783866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2139349844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44980a99-fea5-43d6-b8b3-0bb654fa8e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463c15a1596543c999d11964bdd06950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:52Z,use_quota=True,user_id='3a74bd341ec541f99b1b45df7d318a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf2f166-ae69-4659-a96c-a96a3d8c2b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf2f166-ae69-4659-a96c-a96a3d8c2b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70074d-ba7f-427f-af6a-38ba9b241a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70074d-ba7f-427f-af6a-38ba9b241a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44980a99-fea5-43d6-b8b3-0bb654fa8e7d', 'volume_name': 'volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7393b004-fd1f-4436-a35e-1ca12fc0208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7393b004-fd1f-4436-a35e-1ca12fc0208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f478452-6fea-4952-8419-fb96a7792f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d', 'volume_size': 1} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2139349844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44980a99-fea5-43d6-b8b3-0bb654fa8e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463c15a1596543c999d11964bdd06950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:52Z,use_quota=True,user_id='3a74bd341ec541f99b1b45df7d318a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Creating volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:52 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d 1073741824 Nov 03 07:44:52 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:52 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 Nov 03 07:44:52 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:52 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443" returned: 0 in 0.516s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:52 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443 Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:52 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Flow 'volume_create_manager' (bc626463-5dae-4de9-87ea-c650837405ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb376c8e-055f-41a7-9eba-151148d8ee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb376c8e-055f-41a7-9eba-151148d8ee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1319554144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8414e04fb144018a8109386e4225c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:52Z,use_quota=True,user_id='2c6f3324213d447c81cf6e806a53d4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c347840-88ac-4bb9-b583-d5803fae7b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c347840-88ac-4bb9-b583-d5803fae7b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a8873b-c71e-4c0e-8b4b-a012cfc03b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a8873b-c71e-4c0e-8b4b-a012cfc03b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da', 'volume_name': 'volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacb7d88-31ec-4731-9868-1e07afd682a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacb7d88-31ec-4731-9868-1e07afd682a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211f713c-acc4-4650-b3f5-c219f9b2fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Volume 4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da', 'volume_size': 1} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:52 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d 1073741824" returned: 0 in 0.653s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:52 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87bb4146-5559-44cc-8eb2-4859ee460443" returned: 0 in 0.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-87bb4146-5559-44cc-8eb2-4859ee460443" released by "delete_volume" :: held 0.942s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:52 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d Nov 03 07:44:52 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['74e6f106-97a9-4fb2-ab1e-69ef13d74412', 'fe6ac790-f16c-4692-8977-007c088671ef', 'b826ae5c-d488-4fd1-a73c-76586bfaf822', 'feafc992-2633-44ec-987f-be51274059b0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:53 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:53 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:53 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1319554144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8414e04fb144018a8109386e4225c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:52Z,use_quota=True,user_id='2c6f3324213d447c81cf6e806a53d4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Creating volume 4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-c2dafa90-2992-49bb-9866-c7f1a5cf5d75-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:53 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da 1073741824 Nov 03 07:44:53 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f478452-6fea-4952-8419-fb96a7792f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6baf6-eecc-4183-a76c-7e31b1658c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-c2dafa90-2992-49bb-9866-c7f1a5cf5d75-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Volume volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d (44980a99-fea5-43d6-b8b3-0bb654fa8e7d): created successfully Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6baf6-eecc-4183-a76c-7e31b1658c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Flow 'volume_create_manager' (bd153b1c-4dc4-464c-a98a-ee712cfea4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e554610a-662b-43c8-88f2-838c353a0f6a tempest-VolumesSnapshotListTestJSON-993259471 None] Created volume successfully. Nov 03 07:44:53 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-c2dafa90-2992-49bb-9866-c7f1a5cf5d75" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleted volume successfully. Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-c2dafa90-2992-49bb-9866-c7f1a5cf5d75" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6798b9d4-637a-467b-974a-82a534505075 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-87bb4146-5559-44cc-8eb2-4859ee460443-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485b501-529d-4109-95cc-e3ba331d4c8a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:53 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 Nov 03 07:44:53 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:53 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da 1073741824" returned: 0 in 0.564s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:53 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:53 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da Nov 03 07:44:53 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:53 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75 Nov 03 07:44:53 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:54 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c2dafa90-2992-49bb-9866-c7f1a5cf5d75" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:54 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-c2dafa90-2992-49bb-9866-c7f1a5cf5d75" released by "delete_volume" :: held 0.855s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211f713c-acc4-4650-b3f5-c219f9b2fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ac38d0-24e9-4d0d-857a-4896ae2dcf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Volume volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da (4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da): created successfully Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ac38d0-24e9-4d0d-857a-4896ae2dcf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Flow 'volume_create_manager' (bc626463-5dae-4de9-87ea-c650837405ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a988d535-8a19-48b9-900b-078e3ad79740 tempest-VolumesListTestJSON-1561798033 None] Created volume successfully. Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['e3b284db-4648-46fd-a5d0-584d03195872', '4718c0e3-cde9-4fb7-bcaf-7af7a0a9e9fa', 'c1c9545e-9402-4ef7-8ca4-e72ae7e3525b', '70272dd2-55b8-463b-8d97-541e071a9bc7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:54 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:54 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:54 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:54 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Creating offline snapshot f20bcd02-73c5-479b-9f76-53a3eafb7851 of volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a421fdf5-95b6-4698-abbe-1c598cc3d99e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:54 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d Nov 03 07:44:54 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:54 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleted volume successfully. Nov 03 07:44:54 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:44:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff916e9-f36d-42ad-b1cc-84f690baaf22 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-c2dafa90-2992-49bb-9866-c7f1a5cf5d75-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:55 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" returned: 0 in 0.548s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:55 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 1G Nov 03 07:44:55 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Flow 'volume_create_manager' (0aeb87d9-fc2c-4676-9db0-771c21deb68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f10cb6-9c19-486f-ab6b-50fca272ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f10cb6-9c19-486f-ab6b-50fca272ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1608472420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8414e04fb144018a8109386e4225c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:55Z,use_quota=True,user_id='2c6f3324213d447c81cf6e806a53d4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8bc528-cb25-46e9-beaa-69b3d40a613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8bc528-cb25-46e9-beaa-69b3d40a613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4060b056-5ede-4087-bff9-8e259595b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4060b056-5ede-4087-bff9-8e259595b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1', 'volume_name': 'volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c892da-0da9-4aa0-8af5-1e1c2b565885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c892da-0da9-4aa0-8af5-1e1c2b565885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1424c70-a40a-4cb6-8daa-ce63ecfd709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Volume d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1', 'volume_size': 1} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-c3544c1c-d16a-4cf4-8119-b5191de7549f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-c3544c1c-d16a-4cf4-8119-b5191de7549f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-c3544c1c-d16a-4cf4-8119-b5191de7549f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-c3544c1c-d16a-4cf4-8119-b5191de7549f" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d64392-7abf-49bf-8106-b81693c1821a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:55 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 1G" returned: 0 in 0.586s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:55 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f Nov 03 07:44:55 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:55 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:44:55 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:56 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:56 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f Nov 03 07:44:56 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:56 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:56 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 is being set with open permissions: ugo+rw Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:56 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:44:56 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:56 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c3544c1c-d16a-4cf4-8119-b5191de7549f" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:56 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-c3544c1c-d16a-4cf4-8119-b5191de7549f" released by "delete_volume" :: held 0.769s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:56 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info Nov 03 07:44:56 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['49b349aa-5b0d-4d04-8975-dfc6c9066038', 'd2b6fe29-7fc3-4b45-9ee3-35ead2bd2101', '62b78c34-ad9f-4dce-a063-4fe77f880759', '4e73dbff-4d27-4257-b90c-0a6cbf548436'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:56 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:44:56 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-228e79e9-f057-424d-981b-6a759c6ebd3c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-228e79e9-f057-424d-981b-6a759c6ebd3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-87811877-bcd4-4a7b-943f-a54b40d518b0" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-87811877-bcd4-4a7b-943f-a54b40d518b0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-228e79e9-f057-424d-981b-6a759c6ebd3c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-228e79e9-f057-424d-981b-6a759c6ebd3c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleting offline snapshot 228e79e9-f057-424d-981b-6a759c6ebd3c of volume 87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:56 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] snapshot_file for this snap is: volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:56 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info is being set with open permissions: ugo+rw Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c904d83c-7467-49f3-9221-ffe0269cfc16]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:56 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info Nov 03 07:44:56 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:56 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleted volume successfully. Nov 03 07:44:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f507f4a2-e705-415c-9e39-954de4b430f1 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-c3544c1c-d16a-4cf4-8119-b5191de7549f-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:56 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c Nov 03 07:44:56 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:57 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.info" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1608472420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8414e04fb144018a8109386e4225c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:55Z,use_quota=True,user_id='2c6f3324213d447c81cf6e806a53d4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Creating volume d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:57 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 1073741824 Nov 03 07:44:57 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad3ef827-37a5-4e07-8474-7c9b2a4bd2a4 tempest-VolumesSnapshotListTestJSON-993259471 None] Create snapshot completed successfully Nov 03 07:44:57 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87811877-bcd4-4a7b-943f-a54b40d518b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85975d-6e73-4058-bd5f-63b2880fd100]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:57 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 Nov 03 07:44:57 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:57 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 1073741824" returned: 0 in 0.575s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:57 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 Nov 03 07:44:57 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:57 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0" returned: 0 in 0.519s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:57 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c Nov 03 07:44:57 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:58 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1" returned: 0 in 0.333s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.095s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Creating offline snapshot faf0e6b8-7f84-4f08-8de8-f79417354a31 of volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1424c70-a40a-4cb6-8daa-ce63ecfd709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceb2988-a665-4609-b62f-8a42a368e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11394a5-ea8e-4267-adc9-3158f64791cc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Volume volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 (d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1): created successfully Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceb2988-a665-4609-b62f-8a42a368e591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Flow 'volume_create_manager' (0aeb87d9-fc2c-4676-9db0-771c21deb68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fa8e7e16-1589-4c3e-878a-3533def5d6fe tempest-VolumesListTestJSON-1561798033 None] Created volume successfully. Nov 03 07:44:58 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:58 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:44:58 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c Nov 03 07:44:58 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:58 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:58 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0.228e79e9-f057-424d-981b-6a759c6ebd3c" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:58 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.536s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-228e79e9-f057-424d-981b-6a759c6ebd3c" released by "_delete_snapshot" :: held 1.981s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-87811877-bcd4-4a7b-943f-a54b40d518b0" released by "delete_snapshot" :: held 2.007s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:58 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 1G Nov 03 07:44:58 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['769ff3af-b921-4909-98bf-e835dc911992', 'd678e1cd-713c-4a50-9ea3-44b714c7794b', 'f2f20721-36f9-4d6b-8db4-14000acd51de', '5a8d458a-00e7-42b4-b918-40c24faf2643'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Delete snapshot completed successfully. Nov 03 07:44:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ac29018-d594-4a82-ac12-9786b0ff38b5 tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-228e79e9-f057-424d-981b-6a759c6ebd3c-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:59 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 1G" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:59 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:44:59 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:59 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:59 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 is being set with open permissions: ugo+rw Nov 03 07:44:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:59 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:44:59 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-87811877-bcd4-4a7b-943f-a54b40d518b0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-87811877-bcd4-4a7b-943f-a54b40d518b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:00 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.401s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "cinder-quobyte-87811877-bcd4-4a7b-943f-a54b40d518b0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ecfbae57-1522-480d-b258-25ad765b7e9c tempest-VolumesSnapshotListTestJSON-993259471 None] Create snapshot completed successfully Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-87811877-bcd4-4a7b-943f-a54b40d518b0" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f333f1f-a61c-4966-9c41-9fd5e5ecb653]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:00 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 Nov 03 07:45:00 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:00 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:00 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0 Nov 03 07:45:00 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:01 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-87811877-bcd4-4a7b-943f-a54b40d518b0" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-quobyte-87811877-bcd4-4a7b-943f-a54b40d518b0" released by "delete_volume" :: held 0.890s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Created reservations ['b085f6a8-a6cf-45e9-b340-e2dbf2b198f3', '95e13d89-d405-48f7-a154-21348ffb97fe', '500e9849-58b7-4d87-a124-92071a09f6ee', 'faed9ca0-5f58-4616-b2c1-ca22bb654285'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "cinder-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:01 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:01 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "cinder-quobyte-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-quobyte-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd17400-6954-4771-9698-26438d17d0f4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:01 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 Nov 03 07:45:01 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Creating offline snapshot fd400e39-b118-4166-9f51-7fe0d6979cbf of volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:01 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Deleted volume successfully. Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3c2121-2ce1-45e9-aa22-9fcf721462bc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-be1bcb99-e0ed-4dc3-985f-321faf38eaee tempest-CreateVolumesFromSnapshotTest-355990746 None] Lock "cinder-87811877-bcd4-4a7b-943f-a54b40d518b0-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:01 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:45:01 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:01 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:01 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1 Nov 03 07:45:01 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:02 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:02 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf 1G Nov 03 07:45:02 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:02 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-quobyte-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1" released by "delete_volume" :: held 0.822s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Created reservations ['e3df5ad5-1e92-44c1-a089-caf3ae219f3c', '233a50d6-9d97-47d9-bf54-6c8ebbc298de', '3e5c73e0-7588-4f60-b9da-1a4abd0eb518', 'dec2bc82-16e9-4031-96a8-d900cef42d42'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:02 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:02 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "cinder-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "cinder-quobyte-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-quobyte-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9514421-df0b-4753-9911-c5aea2789393]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:02 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.421s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Deleted volume successfully. Nov 03 07:45:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1ce9b832-f20a-4497-b566-a18863a595eb tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-d5ac5fa7-6fcd-493f-97b3-e6defe3d0cb1-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:02 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf 1G" returned: 0 in 0.910s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:03 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da Nov 03 07:45:03 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:03 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf Nov 03 07:45:03 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:03 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da" returned: 0 in 0.547s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:03 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da Nov 03 07:45:03 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:03 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf" returned: 0 in 0.435s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf is being set with open permissions: ugo+rw Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:03 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf Nov 03 07:45:03 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:03 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:03 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-quobyte-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da" released by "delete_volume" :: held 1.081s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-deb08848-526e-4e94-a6bf-d79036613c42 tempest-VolumesSnapshotListTestJSON-993259471 None] Create snapshot completed successfully Nov 03 07:45:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Created reservations ['c9c69875-ae93-4d04-92de-d008aaef9b14', '33b59f21-e7cf-4c35-b94e-ce97e4dcc7dc', '628f937f-3e1c-4b7c-816e-8579cbb42a36', '0a1347f3-a379-480f-9916-82febb478197'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:04 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:04 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:04 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Deleted volume successfully. Nov 03 07:45:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b98107-d38e-4fdd-997f-58a3f2584ea0 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-4b5d621b-b7c7-4cf6-bd8e-2f8e9c2142da-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "cinder-f9ff039f-2f04-492a-9593-18ec0ce91457-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-f9ff039f-2f04-492a-9593-18ec0ce91457-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "cinder-quobyte-f9ff039f-2f04-492a-9593-18ec0ce91457" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-quobyte-f9ff039f-2f04-492a-9593-18ec0ce91457" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91dffd9-3fef-4034-8509-a83899916956]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:05 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 Nov 03 07:45:05 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:05 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457" returned: 0 in 0.625s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:05 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457 Nov 03 07:45:05 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-fd400e39-b118-4166-9f51-7fe0d6979cbf-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-fd400e39-b118-4166-9f51-7fe0d6979cbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-fd400e39-b118-4166-9f51-7fe0d6979cbf" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-fd400e39-b118-4166-9f51-7fe0d6979cbf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Deleting offline snapshot fd400e39-b118-4166-9f51-7fe0d6979cbf of volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] snapshot_file for this snap is: volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ed4816-35a2-44f2-8130-0dc939dae520]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:06 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f9ff039f-2f04-492a-9593-18ec0ce91457" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-quobyte-f9ff039f-2f04-492a-9593-18ec0ce91457" released by "delete_volume" :: held 1.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:06 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf Nov 03 07:45:06 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Created reservations ['ca115cf3-62f4-4f84-9bd6-8ca586652a22', '5b400c7a-31c3-4b17-8dac-23f6d18acdd5', '7e6866a4-9edf-409d-90d0-f7013651b04f', 'ca35b583-b899-4485-8367-347b679e8980'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:06 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:06 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Flow 'volume_create_manager' (b76c6669-b171-4a7e-8e71-90c031a75f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7843d52e-5ec2-430b-9a3e-7959324a6a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7843d52e-5ec2-430b-9a3e-7959324a6a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3e7099-f4d7-4efd-9f72-82f12184ab5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88c7676426c484a8bd1f72d61e842cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='bac6e07e918641b1be37fce248605369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf5a4a2-3bc6-45ad-83fd-a4592ef2682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf5a4a2-3bc6-45ad-83fd-a4592ef2682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0275fbea-c80e-4e7c-ace8-e87c4753634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0275fbea-c80e-4e7c-ace8-e87c4753634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3e7099-f4d7-4efd-9f72-82f12184ab5e', 'volume_name': 'volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d02e1cb-4dca-464d-8fe4-174119160971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d02e1cb-4dca-464d-8fe4-174119160971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a8934-46e3-4094-9ffb-f17375f6541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Volume dd3e7099-f4d7-4efd-9f72-82f12184ab5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e', 'volume_size': 1} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3e7099-f4d7-4efd-9f72-82f12184ab5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88c7676426c484a8bd1f72d61e842cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='bac6e07e918641b1be37fce248605369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Creating volume dd3e7099-f4d7-4efd-9f72-82f12184ab5e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:06 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e 1073741824 Nov 03 07:45:06 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:06 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf" returned: 0 in 0.567s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b20fec-ca5e-4283-84e0-905bb80ed8da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:06 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Deleted volume successfully. Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dc03294e-8dda-48a5-bc56-07d2ea7f80a7 tempest-VolumesListTestJSON-1561798033 None] Lock "cinder-f9ff039f-2f04-492a-9593-18ec0ce91457-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:07 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:45:07 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:07 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e 1073741824" returned: 0 in 0.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:07 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:07 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf Nov 03 07:45:07 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:07 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e Nov 03 07:45:07 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:07 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a8934-46e3-4094-9ffb-f17375f6541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ce40b5-f4ba-4fab-a5b5-3b3346d4ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Volume volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e (dd3e7099-f4d7-4efd-9f72-82f12184ab5e): created successfully Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ce40b5-f4ba-4fab-a5b5-3b3346d4ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Flow 'volume_create_manager' (b76c6669-b171-4a7e-8e71-90c031a75f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9c0179e8-79af-4773-b60a-c4a8c8a0d0f4 tempest-CinderUnicodeTest-1313148812 None] Created volume successfully. Nov 03 07:45:08 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf" returned: 0 in 0.601s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:08 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf Nov 03 07:45:08 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:08 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.fd400e39-b118-4166-9f51-7fe0d6979cbf" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-fd400e39-b118-4166-9f51-7fe0d6979cbf" released by "_delete_snapshot" :: held 2.157s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" released by "delete_snapshot" :: held 2.204s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Created reservations ['64fef2a7-1391-44d4-940d-6ce1c53483ee', '68781725-085d-443b-936b-36bb450dde68', '98a91ec6-daab-4d38-82f0-49e042696fa7', 'b0342f52-23df-4afa-94cb-dd8c0c0da721'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Delete snapshot completed successfully. Nov 03 07:45:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d29f075-03d8-4c94-9993-fe460490a521 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-fd400e39-b118-4166-9f51-7fe0d6979cbf-delete_snapshot" released by "delete_snapshot" :: held 2.396s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-faf0e6b8-7f84-4f08-8de8-f79417354a31-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-faf0e6b8-7f84-4f08-8de8-f79417354a31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-faf0e6b8-7f84-4f08-8de8-f79417354a31" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Flow 'volume_create_manager' (a41b0829-3587-462c-bd14-03b73de04d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2bb9f4-30f7-438a-9c52-a44d54e0c9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-faf0e6b8-7f84-4f08-8de8-f79417354a31" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Deleting offline snapshot faf0e6b8-7f84-4f08-8de8-f79417354a31 of volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] snapshot_file for this snap is: volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2bb9f4-30f7-438a-9c52-a44d54e0c9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-231377441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3667e5aa-a2ad-4d34-aefc-37705442f2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88c7676426c484a8bd1f72d61e842cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:09Z,use_quota=True,user_id='bac6e07e918641b1be37fce248605369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c0f666-22b5-4a9f-9d77-4af36a685a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c0f666-22b5-4a9f-9d77-4af36a685a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae288ac4-a09a-4823-b1f0-b4dcc591d53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae288ac4-a09a-4823-b1f0-b4dcc591d53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3667e5aa-a2ad-4d34-aefc-37705442f2c4', 'volume_name': 'volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c034c72-8dd0-46ce-9dd3-d54c30e28975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c034c72-8dd0-46ce-9dd3-d54c30e28975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75f6fef-711a-43c1-b92a-784a01ae4f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Volume 3667e5aa-a2ad-4d34-aefc-37705442f2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4', 'volume_size': 1} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-231377441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3667e5aa-a2ad-4d34-aefc-37705442f2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88c7676426c484a8bd1f72d61e842cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:09Z,use_quota=True,user_id='bac6e07e918641b1be37fce248605369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Creating volume 3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957a4a9-55f9-4e02-96b9-e34e6cf28edc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:09 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 1073741824 Nov 03 07:45:09 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:09 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:45:09 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:10 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab8244-da48-4f75-9288-d5f6a181689a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:10 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 1073741824" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:45:10 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:10 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 Nov 03 07:45:10 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:10 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:10 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:45:10 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:10 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75f6fef-711a-43c1-b92a-784a01ae4f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af77b04-8ac0-4d14-b5b8-031a6fbaeda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Volume volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 (3667e5aa-a2ad-4d34-aefc-37705442f2c4): created successfully Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af77b04-8ac0-4d14-b5b8-031a6fbaeda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Flow 'volume_create_manager' (a41b0829-3587-462c-bd14-03b73de04d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-331be2e8-cd0b-4e65-9077-e80b2b0d5d0f tempest-CinderUnicodeTest-1313148812 None] Created volume successfully. Nov 03 07:45:11 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:11 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31 Nov 03 07:45:11 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:11 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.faf0e6b8-7f84-4f08-8de8-f79417354a31" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-faf0e6b8-7f84-4f08-8de8-f79417354a31" released by "_delete_snapshot" :: held 1.987s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" released by "delete_snapshot" :: held 2.059s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Created reservations ['e4758920-772e-4198-80d7-b6ba6d073e55', '832f0d2d-e1f1-46f1-bc65-9dc2a4b76616', 'd7a569d9-4e0d-48eb-8970-cef8fc4d1f8f', '07860447-f629-4088-bc15-0deee8eb4df2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Delete snapshot completed successfully. Nov 03 07:45:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26f91039-ec08-4341-83bb-ed5c71aa86df tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-faf0e6b8-7f84-4f08-8de8-f79417354a31-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Creating offline snapshot 627e1da3-af8b-4593-bfe9-fe527dc0a469 of volume 3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04cac7b-97e6-4de7-89d4-582bed23ce3e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:12 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 Nov 03 07:45:12 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:12 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4" returned: 0 in 0.499s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:12 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 1G Nov 03 07:45:12 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-f20bcd02-73c5-479b-9f76-53a3eafb7851-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-f20bcd02-73c5-479b-9f76-53a3eafb7851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-f20bcd02-73c5-479b-9f76-53a3eafb7851" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-f20bcd02-73c5-479b-9f76-53a3eafb7851" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Deleting offline snapshot f20bcd02-73c5-479b-9f76-53a3eafb7851 of volume 44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] snapshot_file for this snap is: volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[92adf36a-47dc-4106-b8b3-77743bd36b37]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:45:13 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 1G" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 Nov 03 07:45:13 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.567s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d4aba-90fb-4066-9c4b-5e8394948f81]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d Nov 03 07:45:13 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 is being set with open permissions: ugo+rw Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:13 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 Nov 03 07:45:13 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:13 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" returned: 0 in 0.549s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:45:14 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info Nov 03 07:45:14 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:14 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info is being set with open permissions: ugo+rw Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.498s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:14 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info Nov 03 07:45:14 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:14 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851 Nov 03 07:45:14 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:14 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.info" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=166,cinder:SELECT=145,cinder:INSERT=47,cinder:DELETE=17 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d.f20bcd02-73c5-479b-9f76-53a3eafb7851" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-f20bcd02-73c5-479b-9f76-53a3eafb7851" released by "_delete_snapshot" :: held 2.220s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-33fe7e7e-e7ef-4b37-ac9f-10cc68b5b8d7 tempest-CinderUnicodeTest-1313148812 None] Create snapshot completed successfully Nov 03 07:45:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" released by "delete_snapshot" :: held 2.255s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=131,cinder:UPDATE=174,cinder:DELETE=14,cinder:INSERT=33 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Created reservations ['ab164993-e1b9-4896-84f8-865e01738690', 'b6dd8e3b-7325-48a4-83bc-f29cd5487f99', '891833d6-1cf9-4f47-84e5-7743c2beee9a', 'c1f8e953-a4fd-4abf-a316-47e8d50b4a25'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Delete snapshot completed successfully. Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2cff61b3-149c-47c6-b5fd-2acb00f20833 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-f20bcd02-73c5-479b-9f76-53a3eafb7851-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-627e1da3-af8b-4593-bfe9-fe527dc0a469-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-627e1da3-af8b-4593-bfe9-fe527dc0a469-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-quobyte-3667e5aa-a2ad-4d34-aefc-37705442f2c4" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-3667e5aa-a2ad-4d34-aefc-37705442f2c4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-quobyte-627e1da3-af8b-4593-bfe9-fe527dc0a469" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-627e1da3-af8b-4593-bfe9-fe527dc0a469" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Deleting offline snapshot 627e1da3-af8b-4593-bfe9-fe527dc0a469 of volume 3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] snapshot_file for this snap is: volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[854bff26-f9bf-419b-83fb-23093550e4a6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:15 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 Nov 03 07:45:15 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469" returned: 0 in 0.480s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-44980a99-fea5-43d6-b8b3-0bb654fa8e7d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7fc529-54e1-4ee0-91f6-63bab98cf584]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-44980a99-fea5-43d6-b8b3-0bb654fa8e7d-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:16 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 Nov 03 07:45:16 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[44362f86-bc1e-4685-bde1-3519d3f945e5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d Nov 03 07:45:16 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4" returned: 0 in 0.599s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 Nov 03 07:45:16 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:16 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" returned: 0 in 0.543s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:16 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d Nov 03 07:45:16 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:17 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469 Nov 03 07:45:17 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:17 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-quobyte-44980a99-fea5-43d6-b8b3-0bb654fa8e7d" released by "delete_volume" :: held 1.012s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Created reservations ['475f42b2-9bf4-4a6f-83f9-0246e243f5f8', 'e75db340-8a49-4a26-9440-59da687a1808', 'cb5de61b-64de-4412-9c25-87269f24049c', 'a69e121d-709f-43f2-a821-40ea9acbed64'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:17 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4.627e1da3-af8b-4593-bfe9-fe527dc0a469" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-627e1da3-af8b-4593-bfe9-fe527dc0a469" released by "_delete_snapshot" :: held 2.078s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-3667e5aa-a2ad-4d34-aefc-37705442f2c4" released by "delete_snapshot" :: held 2.157s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Created reservations ['35dcbeec-7c03-440a-9fec-d1acb4abcfb0', 'd242cdaa-d236-478c-b537-0f36b2da92a9', '98df037f-e515-44fd-9eca-8cdc0466c345', '3cb709b5-41de-46f0-be60-20899ebd2265'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Delete snapshot completed successfully. Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39afe518-3cea-4ac8-9201-e497f2a06b27 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-627e1da3-af8b-4593-bfe9-fe527dc0a469-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:17 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Deleted volume successfully. Nov 03 07:45:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91934153-f8a4-4fc5-84bc-f041106a14f8 tempest-VolumesSnapshotListTestJSON-993259471 None] Lock "cinder-44980a99-fea5-43d6-b8b3-0bb654fa8e7d-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-3667e5aa-a2ad-4d34-aefc-37705442f2c4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-3667e5aa-a2ad-4d34-aefc-37705442f2c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-quobyte-3667e5aa-a2ad-4d34-aefc-37705442f2c4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-3667e5aa-a2ad-4d34-aefc-37705442f2c4" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4000482-b340-4eb5-b990-224e908ddbfb]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 Nov 03 07:45:19 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4" returned: 0 in 0.593s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:19 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4 Nov 03 07:45:19 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:19 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3667e5aa-a2ad-4d34-aefc-37705442f2c4" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-3667e5aa-a2ad-4d34-aefc-37705442f2c4" released by "delete_volume" :: held 1.107s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Created reservations ['86bf26ab-a267-499e-a9b2-83d378543209', 'bf71b2da-2948-4762-8c9a-bdba872dee6d', '57937a19-3686-4f7d-8230-5cdfc5441bab', '31993ec4-b348-4237-9049-97fdbb58742e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:20 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:20 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:20 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Deleted volume successfully. Nov 03 07:45:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00a44a44-b841-43ab-81f8-9068289e8d13 tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-3667e5aa-a2ad-4d34-aefc-37705442f2c4-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-dd3e7099-f4d7-4efd-9f72-82f12184ab5e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-dd3e7099-f4d7-4efd-9f72-82f12184ab5e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "cinder-quobyte-dd3e7099-f4d7-4efd-9f72-82f12184ab5e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-dd3e7099-f4d7-4efd-9f72-82f12184ab5e" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0371d561-f326-485b-a811-b995e31a6d1a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e Nov 03 07:45:21 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:21 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e" returned: 0 in 0.593s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:21 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e Nov 03 07:45:21 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:22 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dd3e7099-f4d7-4efd-9f72-82f12184ab5e" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-quobyte-dd3e7099-f4d7-4efd-9f72-82f12184ab5e" released by "delete_volume" :: held 1.054s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Created reservations ['49e0eca5-26e0-490c-abdd-ff3637775231', '2e914d48-1c38-4e86-b613-05a08d141d87', 'a4335360-7b8e-4bea-985b-2646b9f058ea', 'b6437cfb-f32b-42df-bad5-5cca6429717f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:22 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:22 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:22 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Deleted volume successfully. Nov 03 07:45:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-21ec4397-fba0-4b57-a0b2-c5928dd2b62f tempest-CinderUnicodeTest-1313148812 None] Lock "cinder-dd3e7099-f4d7-4efd-9f72-82f12184ab5e-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (d5fad88c-01d9-4364-9eb2-bf629a10e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57ff209-8a0c-40ad-9522-38e856e595ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57ff209-8a0c-40ad-9522-38e856e595ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1982931421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9904b12-b814-4947-90f7-4210064de41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:30Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f950c7e4-0b41-4259-95d3-4bc7ca964d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f950c7e4-0b41-4259-95d3-4bc7ca964d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a892b39e-b134-436a-8830-b498597d1287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a892b39e-b134-436a-8830-b498597d1287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9904b12-b814-4947-90f7-4210064de41c', 'volume_name': 'volume-b9904b12-b814-4947-90f7-4210064de41c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3338b7d8-4bf1-4e07-accc-4f1326bf5ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3338b7d8-4bf1-4e07-accc-4f1326bf5ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c30c6c2-08d2-4d31-97a8-1df98a0a76a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume b9904b12-b814-4947-90f7-4210064de41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9904b12-b814-4947-90f7-4210064de41c', 'volume_size': 1} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1982931421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9904b12-b814-4947-90f7-4210064de41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:30Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating volume b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:30 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c 1073741824 Nov 03 07:45:30 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:31 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c 1073741824" returned: 0 in 0.672s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:31 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c Nov 03 07:45:31 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:31 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c30c6c2-08d2-4d31-97a8-1df98a0a76a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9904b12-b814-4947-90f7-4210064de41c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a238d9-5e33-40cc-8555-2dd0568890bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume volume-b9904b12-b814-4947-90f7-4210064de41c (b9904b12-b814-4947-90f7-4210064de41c): created successfully Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a238d9-5e33-40cc-8555-2dd0568890bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (d5fad88c-01d9-4364-9eb2-bf629a10e253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6fec7bf0-e808-4e82-9c67-9b7c679b19d0 tempest-VolumesSnapshotTestJSON-1663042263 None] Created volume successfully. Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Creating offline snapshot a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 of volume b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfb058c-8637-4509-b1f3-d45fdf3b9061]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:33 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c Nov 03 07:45:33 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:33 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c" returned: 0 in 0.491s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:33 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 1G Nov 03 07:45:33 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:34 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 1G" returned: 0 in 0.604s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9904b12-b814-4947-90f7-4210064de41c -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:34 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9904b12-b814-4947-90f7-4210064de41c -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 Nov 03 07:45:34 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:34 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9904b12-b814-4947-90f7-4210064de41c -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:34 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 is being set with open permissions: ugo+rw Nov 03 07:45:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:34 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 Nov 03 07:45:34 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:34 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:35 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info Nov 03 07:45:35 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:35 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info is being set with open permissions: ugo+rw Nov 03 07:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:35 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info Nov 03 07:45:35 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:35 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.info" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fa677be6-44bc-408b-a35d-8eee4a557d9b tempest-VolumesSnapshotTestJSON-1663042263 None] Create snapshot completed successfully Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-a0eeab75-ba08-4d7c-bfb0-00fc628f7d19-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-a0eeab75-ba08-4d7c-bfb0-00fc628f7d19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-b9904b12-b814-4947-90f7-4210064de41c" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-b9904b12-b814-4947-90f7-4210064de41c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Deleting offline snapshot a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 of volume b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] snapshot_file for this snap is: volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e48542-dfbb-4ba8-a9ff-65c0154ea001]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:36 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 Nov 03 07:45:36 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:37 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" returned: 0 in 0.531s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9904b12-b814-4947-90f7-4210064de41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:45:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b81c11-69c8-45d4-8ebd-ea7eb5363679]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:37 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c Nov 03 07:45:37 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:37 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c" returned: 0 in 0.502s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:37 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 Nov 03 07:45:37 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:38 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" returned: 0 in 0.477s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:38 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19 Nov 03 07:45:38 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:38 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c.a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-a0eeab75-ba08-4d7c-bfb0-00fc628f7d19" released by "_delete_snapshot" :: held 1.960s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-b9904b12-b814-4947-90f7-4210064de41c" released by "delete_snapshot" :: held 1.993s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['6b13a732-440c-460b-8959-c35cc0d0a112', '2fc1d494-0047-4349-ba98-d32a879adcf0', '2bac691c-4b0f-456d-b29e-2937600aeed4', '8c787281-cc67-47f0-b393-b7d387f4f7eb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:45:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Delete snapshot completed successfully. Nov 03 07:45:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-afb123e5-ea7b-4694-9230-7d29c7f3bd3f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-a0eeab75-ba08-4d7c-bfb0-00fc628f7d19-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Flow 'volume_create_manager' (bd26105a-edf3-451f-b02d-32a4fb95c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504f289a-de3e-4fdb-8157-8176f6f9e44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504f289a-de3e-4fdb-8157-8176f6f9e44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1481556554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fcb8f3-a4d4-4391-91c8-eea25835f2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c69164b5c0425494b923013574b308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:39Z,use_quota=True,user_id='00eed8a73ce7452ead95b98b6bdbabf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebdbb1a-f643-4ac0-aaac-ebd5341b046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebdbb1a-f643-4ac0-aaac-ebd5341b046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384c9d56-0777-49a1-83c0-463bbd133363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384c9d56-0777-49a1-83c0-463bbd133363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fcb8f3-a4d4-4391-91c8-eea25835f2a6', 'volume_name': 'volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017bb910-b0df-4cdc-b6ab-1c66d7010a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017bb910-b0df-4cdc-b6ab-1c66d7010a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f603c50b-4711-420f-80a7-807f2ca4e382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Volume 89fcb8f3-a4d4-4391-91c8-eea25835f2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6', 'volume_size': 1} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1481556554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fcb8f3-a4d4-4391-91c8-eea25835f2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c69164b5c0425494b923013574b308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:39Z,use_quota=True,user_id='00eed8a73ce7452ead95b98b6bdbabf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Creating volume 89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:39 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 1073741824 Nov 03 07:45:39 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:40 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 1073741824" returned: 0 in 0.667s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:40 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 Nov 03 07:45:40 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (d7cb0930-9a2e-4a69-aa80-a3ad68add235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf1859c-4955-4554-b276-495957b61145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf1859c-4955-4554-b276-495957b61145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583717843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5c0a64-8e8d-4a41-aac1-17faa065f2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:41Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83f67be-621f-462f-be5a-5cff14793ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83f67be-621f-462f-be5a-5cff14793ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3c0a8-1ae9-4f21-839e-9e0b39671d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3c0a8-1ae9-4f21-839e-9e0b39671d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5c0a64-8e8d-4a41-aac1-17faa065f2f5', 'volume_name': 'volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c8be3-62fb-4fe5-8018-2e54374073df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c8be3-62fb-4fe5-8018-2e54374073df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbe6b47-c78e-4c35-aa4a-a06b3456de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Volume 7b5c0a64-8e8d-4a41-aac1-17faa065f2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5', 'volume_size': 1} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:40 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583717843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5c0a64-8e8d-4a41-aac1-17faa065f2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:41Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Creating volume 7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:40 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 1073741824 Nov 03 07:45:40 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f603c50b-4711-420f-80a7-807f2ca4e382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3696a9-4cc0-4f20-a2de-768944111da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Volume volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 (89fcb8f3-a4d4-4391-91c8-eea25835f2a6): created successfully Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3696a9-4cc0-4f20-a2de-768944111da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Flow 'volume_create_manager' (bd26105a-edf3-451f-b02d-32a4fb95c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-71c9782d-d3bf-4aec-a3da-03bc78455bd7 tempest-TestImageHashVerification-95232819 None] Created volume successfully. Nov 03 07:45:41 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 1073741824" returned: 0 in 0.502s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:41 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 Nov 03 07:45:41 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:41 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbe6b47-c78e-4c35-aa4a-a06b3456de0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0586d36d-dc48-49ea-adbf-fb77db054db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Volume volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 (7b5c0a64-8e8d-4a41-aac1-17faa065f2f5): created successfully Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0586d36d-dc48-49ea-adbf-fb77db054db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (d7cb0930-9a2e-4a69-aa80-a3ad68add235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e4c10751-c3d0-4787-a4c6-2e2493d1c1cd tempest-VolumesSnapshotTestJSON-1663042263 None] Created volume successfully. Nov 03 07:45:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d99f7-d3fd-420c-8cac-aeec7a729693]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:42 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 Nov 03 07:45:42 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:43 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" returned: 0 in 0.437s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c32807-0c18-46af-a050-50447366ad6d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:43 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 Nov 03 07:45:43 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:43 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" returned: 0 in 0.451s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 /opt/stack/data/cinder/conversion/89fcb8f3-a4d4-4391-91c8-eea25835f2a6.temp_image.3665e7c3-bca2-4d6d-8e61-667c3c776323wq7muq4g.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:43 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 /opt/stack/data/cinder/conversion/89fcb8f3-a4d4-4391-91c8-eea25835f2a6.temp_image.3665e7c3-bca2-4d6d-8e61-667c3c776323wq7muq4g.img Nov 03 07:45:43 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:50 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 /opt/stack/data/cinder/conversion/89fcb8f3-a4d4-4391-91c8-eea25835f2a6.temp_image.3665e7c3-bca2-4d6d-8e61-667c3c776323wq7muq4g.img" returned: 0 in 7.214s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f948a-96df-4022-9d4f-12810aae8446]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:50 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 Nov 03 07:45:50 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:51 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" returned: 0 in 0.558s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:51 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/conversion/89fcb8f3-a4d4-4391-91c8-eea25835f2a6.temp_image.3665e7c3-bca2-4d6d-8e61-667c3c776323wq7muq4g.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:45:51 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Converted 1024.00 MB image at 141.91 MB/s Nov 03 07:45:51 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] 3665e7c3-bca2-4d6d-8e61-667c3c776323 was raw, no need to convert to raw {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:54 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:45:54 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:54 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:45:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Flow 'volume_create_manager' (da6ebec6-a642-4f2c-bb5d-83650203b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e3cf7-9943-486f-9ae1-23621309de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e3cf7-9943-486f-9ae1-23621309de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-971865022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d1bdd4c3b74b3f947ceb9ae302301c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:59Z,use_quota=True,user_id='479c9c9590a84450af90b2808179b3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44eb15ae-ea58-422b-95fe-2c064b9f95ee),volume_type_id=44eb15ae-ea58-422b-95fe-2c064b9f95ee)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14553a81-e0da-428c-99ef-9bd40072f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14553a81-e0da-428c-99ef-9bd40072f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f825f57b-ae0c-4087-ae18-8197296be133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f825f57b-ae0c-4087-ae18-8197296be133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e', 'volume_name': 'volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f45a425-55db-4b1c-98cb-cba9141aada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f45a425-55db-4b1c-98cb-cba9141aada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dca9f11-a6aa-48cc-bb6d-4479ee3892e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e', 'volume_size': 1} Nov 03 07:45:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Flow 'volume_create_manager' (8fe0a0b0-53bd-48e5-848a-6ee7b4d08541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27f8640-3a96-44a1-9ea4-274a19bf2143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27f8640-3a96-44a1-9ea4-274a19bf2143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-894328717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14e1246-5918-4a70-8122-ffd71ef090a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d1bdd4c3b74b3f947ceb9ae302301c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:59Z,use_quota=True,user_id='479c9c9590a84450af90b2808179b3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63571115-fc31-42d0-a40e-4b94450bcf6b),volume_type_id=63571115-fc31-42d0-a40e-4b94450bcf6b)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdf5186-6d26-4610-ae77-ffc14f1e6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdf5186-6d26-4610-ae77-ffc14f1e6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bc6de6-e325-46c3-b214-b71657db6f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bc6de6-e325-46c3-b214-b71657db6f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14e1246-5918-4a70-8122-ffd71ef090a0', 'volume_name': 'volume-c14e1246-5918-4a70-8122-ffd71ef090a0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398f0b6c-8ae5-4ba7-a1e4-7c5178c73b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398f0b6c-8ae5-4ba7-a1e4-7c5178c73b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5278a8-6af6-4cd9-ac1e-a1c1b109d577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume c14e1246-5918-4a70-8122-ffd71ef090a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14e1246-5918-4a70-8122-ffd71ef090a0', 'volume_size': 1} Nov 03 07:45:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Flow 'volume_create_manager' (7b16bc91-49f8-4758-811f-ed70102901a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6239ec-de32-403f-b571-e90ff2dfcd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6239ec-de32-403f-b571-e90ff2dfcd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1597972343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee46b7a-1208-464e-a788-f56d239a82be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d1bdd4c3b74b3f947ceb9ae302301c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:00Z,use_quota=True,user_id='479c9c9590a84450af90b2808179b3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1d54ed-ac81-4eda-a675-8c4e71070cce),volume_type_id=3e1d54ed-ac81-4eda-a675-8c4e71070cce)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8a7977-a8ec-4116-b8d7-6ca14435d9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8a7977-a8ec-4116-b8d7-6ca14435d9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330094b7-d1c8-4426-9fc9-d498fc99b4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330094b7-d1c8-4426-9fc9-d498fc99b4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ee46b7a-1208-464e-a788-f56d239a82be', 'volume_name': 'volume-9ee46b7a-1208-464e-a788-f56d239a82be', 'volume_size': 1, 'image_id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3800d7d3-6e21-43b1-af8a-34ee771bba05', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--970198247', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6d1bdd4c3b74b3f947ceb9ae302301c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3800d7d3-6e21-43b1-af8a-34ee771bba05/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf80cd87-aab3-472c-a741-e0d5e6e1469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf80cd87-aab3-472c-a741-e0d5e6e1469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a111e822-af7a-4125-9adc-f998d740df54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume 9ee46b7a-1208-464e-a788-f56d239a82be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ee46b7a-1208-464e-a788-f56d239a82be', 'volume_size': 1, 'image_id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3800d7d3-6e21-43b1-af8a-34ee771bba05', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--970198247', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6d1bdd4c3b74b3f947ceb9ae302301c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3800d7d3-6e21-43b1-af8a-34ee771bba05/file', 'properties': {}}, 'image_service': } Nov 03 07:46:00 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Trying to clone 9ee46b7a-1208-464e-a788-f56d239a82be from image 3800d7d3-6e21-43b1-af8a-34ee771bba05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3800d7d3-6e21-43b1-af8a-34ee771bba05', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD, size 20.69 MB, duration 4.42 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:46:05 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Image download 20.69 MB at 4.68 MB/s Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f56577-00fe-422c-b9ea-b90e7faadcc9]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD Nov 03 07:46:05 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Temporary image 3800d7d3-6e21-43b1-af8a-34ee771bba05 is fetched for user 479c9c9590a84450af90b2808179b3fa. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d7c1b-8cc8-47a1-b16d-05b1e77962c6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD Nov 03 07:46:05 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:06 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.652s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Uploaded volume to glance image-id: 3665e7c3-bca2-4d6d-8e61-667c3c776323. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 28.400s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating offline snapshot d3911cba-2365-401d-a855-71e1259090f6 of volume 7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5a5b7af9-676a-4156-915d-b77a65d586a7 tempest-TestImageHashVerification-95232819 None] Copy volume to image completed successfully. Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b72868-13b7-490f-afa2-b80a8cc0bc79]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:11 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 Nov 03 07:46:11 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:11 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:11 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 1G Nov 03 07:46:11 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Acquiring lock "cinder-89fcb8f3-a4d4-4391-91c8-eea25835f2a6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Lock "cinder-89fcb8f3-a4d4-4391-91c8-eea25835f2a6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Acquiring lock "cinder-quobyte-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Lock "cinder-quobyte-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fca1bc-0819-496b-88b3-1d63cc65d357]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 1G" returned: 0 in 0.520s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 Nov 03 07:46:12 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 Nov 03 07:46:12 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 is being set with open permissions: ugo+rw Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6 Nov 03 07:46:12 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 Nov 03 07:46:12 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" returned: 0 in 0.262s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Lock "cinder-quobyte-89fcb8f3-a4d4-4391-91c8-eea25835f2a6" released by "delete_volume" :: held 0.703s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:12 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:12 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info Nov 03 07:46:12 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Created reservations ['96d73f88-f95a-4f8d-bf72-89698eb8853b', '126d887d-e682-4534-ab00-190db7c7ffa1', 'af27e389-43a0-4e9e-a80b-e163fdbf78f0', 'e0236ef1-d2f6-4609-b155-e80f17d270ff'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:13 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:46:13 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:13 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info is being set with open permissions: ugo+rw Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:13 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info Nov 03 07:46:13 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:13 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Deleted volume successfully. Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-953beb1f-5141-4686-ad1e-0023684aa41d tempest-TestImageHashVerification-95232819 None] Lock "cinder-89fcb8f3-a4d4-4391-91c8-eea25835f2a6-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:13 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.info" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.675s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-971865022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d1bdd4c3b74b3f947ceb9ae302301c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:59Z,use_quota=True,user_id='479c9c9590a84450af90b2808179b3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44eb15ae-ea58-422b-95fe-2c064b9f95ee),volume_type_id=44eb15ae-ea58-422b-95fe-2c064b9f95ee)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Creating volume e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:46:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:13 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e 1073741824 Nov 03 07:46:13 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4f53598a-81d9-40a5-9dab-d5e345b45030 tempest-VolumesSnapshotTestJSON-1663042263 None] Create snapshot completed successfully Nov 03 07:46:14 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e 1073741824" returned: 0 in 0.470s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:14 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e Nov 03 07:46:14 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:14 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.809s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-894328717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14e1246-5918-4a70-8122-ffd71ef090a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d1bdd4c3b74b3f947ceb9ae302301c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:59Z,use_quota=True,user_id='479c9c9590a84450af90b2808179b3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63571115-fc31-42d0-a40e-4b94450bcf6b),volume_type_id=63571115-fc31-42d0-a40e-4b94450bcf6b)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Creating volume c14e1246-5918-4a70-8122-ffd71ef090a0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:14 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 1073741824 Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dca9f11-a6aa-48cc-bb6d-4479ee3892e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:14 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127a75f3-6fc4-4492-95e6-a0374e09a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e (e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e): created successfully Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127a75f3-6fc4-4492-95e6-a0374e09a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Flow 'volume_create_manager' (da6ebec6-a642-4f2c-bb5d-83650203b15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0cfd1ac1-1cd1-4fce-9957-90c7d4d44de3 tempest-TestInstancesWithCinderVolumes-1463220248 None] Created volume successfully. Nov 03 07:46:15 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 1073741824" returned: 0 in 0.625s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=63,cinder:INSERT=19,cinder:UPDATE=61,cinder:DELETE=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=61,cinder:INSERT=16,cinder:UPDATE=71,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (659a843a-bf81-43eb-b246-b0da6b741b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:15 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 Nov 03 07:46:15 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdbd1c1-b5e2-4d5b-8db9-9bff840d1651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdbd1c1-b5e2-4d5b-8db9-9bff840d1651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-817178011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04af5338-e6c6-4f74-b234-9cb5b41c3e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d3911cba-2365-401d-a855-71e1259090f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:15Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9273a80b-1593-4853-982b-2b8e6646416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9273a80b-1593-4853-982b-2b8e6646416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708c9b95-de18-4de5-a439-3ee5d33f8878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708c9b95-de18-4de5-a439-3ee5d33f8878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04af5338-e6c6-4f74-b234-9cb5b41c3e1a', 'volume_name': 'volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a', 'volume_size': 2, 'snapshot_id': 'd3911cba-2365-401d-a855-71e1259090f6'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65747bd-8ae4-4139-a024-f5d0ab927fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65747bd-8ae4-4139-a024-f5d0ab927fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60fe044-78d0-4b86-84e0-9182392ae113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume 04af5338-e6c6-4f74-b234-9cb5b41c3e1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a', 'volume_size': 2, 'snapshot_id': 'd3911cba-2365-401d-a855-71e1259090f6'} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:15 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.385s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1597972343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee46b7a-1208-464e-a788-f56d239a82be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d1bdd4c3b74b3f947ceb9ae302301c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:00Z,use_quota=True,user_id='479c9c9590a84450af90b2808179b3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1d54ed-ac81-4eda-a675-8c4e71070cce),volume_type_id=3e1d54ed-ac81-4eda-a675-8c4e71070cce)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Creating volume 9ee46b7a-1208-464e-a788-f56d239a82be {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:15 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be 1073741824 Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5278a8-6af6-4cd9-ac1e-a1c1b109d577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14e1246-5918-4a70-8122-ffd71ef090a0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:15 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33f48fc-cdff-409f-a6bc-fb8e6ae97cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume volume-c14e1246-5918-4a70-8122-ffd71ef090a0 (c14e1246-5918-4a70-8122-ffd71ef090a0): created successfully Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33f48fc-cdff-409f-a6bc-fb8e6ae97cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Flow 'volume_create_manager' (8fe0a0b0-53bd-48e5-848a-6ee7b4d08541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e79a97a7-cebc-42a1-8a1d-479e833d75a6 tempest-TestInstancesWithCinderVolumes-1463220248 None] Created volume successfully. Nov 03 07:46:15 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be 1073741824" returned: 0 in 0.443s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:15 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be Nov 03 07:46:15 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.924s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-d3911cba-2365-401d-a855-71e1259090f6-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-d3911cba-2365-401d-a855-71e1259090f6-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating volume 04af5338-e6c6-4f74-b234-9cb5b41c3e1a from snapshot d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Attempting download of 3800d7d3-6e21-43b1-af8a-34ee771bba05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3800d7d3-6e21-43b1-af8a-34ee771bba05', 'metadata': {}}])) to volume 9ee46b7a-1208-464e-a788-f56d239a82be. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] snapshot: d3911cba-2365-401d-a855-71e1259090f6, volume: 04af5338-e6c6-4f74-b234-9cb5b41c3e1a, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae0617-dce9-4375-afc1-8e3377db6dcc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f7ff9c-2a22-44ca-b1eb-bdf63df67597]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:16 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 Nov 03 07:46:16 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3 Nov 03 07:46:16 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:16 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9596910c-b67f-4127-b1ed-9cdd6b08dbe7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:16 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3 Nov 03 07:46:16 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 Nov 03 07:46:16 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3" returned: 1 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3800d7d3-6e21-43b1-af8a-34ee771bba05_nrk_yss3' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc839636-e921-487d-92a6-d5abe1dcafed]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:17 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:46:17 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD Nov 03 07:46:17 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:17 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a Nov 03 07:46:17 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:17 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] 3800d7d3-6e21-43b1-af8a-34ee771bba05 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:46:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:17 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be Nov 03 07:46:17 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:23 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be" returned: 0 in 5.530s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3800d7d3-6e21-43b1-af8a-34ee771bba05_zrm5dbeidevstack@QuobyteHD, size 112.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:46:23 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Converted 112.00 MB image at 20.24 MB/s Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:23 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be 1G Nov 03 07:46:23 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:23 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be 1G" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Downloaded image 3800d7d3-6e21-43b1-af8a-34ee771bba05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3800d7d3-6e21-43b1-af8a-34ee771bba05', 'metadata': {}}])) to volume 9ee46b7a-1208-464e-a788-f56d239a82be successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Temporary image 3800d7d3-6e21-43b1-af8a-34ee771bba05 for user 479c9c9590a84450af90b2808179b3fa is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Marking volume 9ee46b7a-1208-464e-a788-f56d239a82be as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Copying metadata from image 3800d7d3-6e21-43b1-af8a-34ee771bba05 to 9ee46b7a-1208-464e-a788-f56d239a82be. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Creating volume glance metadata for volume 9ee46b7a-1208-464e-a788-f56d239a82be backed by image 3800d7d3-6e21-43b1-af8a-34ee771bba05 with: {'image_id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'image_name': 'tempest-scenario-img--970198247', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a111e822-af7a-4125-9adc-f998d740df54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee46b7a-1208-464e-a788-f56d239a82be', 'volume_size': 1, 'image_id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3800d7d3-6e21-43b1-af8a-34ee771bba05', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--970198247', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6d1bdd4c3b74b3f947ceb9ae302301c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3800d7d3-6e21-43b1-af8a-34ee771bba05', 'created_at': datetime.datetime(2026, 11, 3, 6, 45, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 45, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3800d7d3-6e21-43b1-af8a-34ee771bba05/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34292e31-469c-4c46-92a0-e72f9b179551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Volume volume-9ee46b7a-1208-464e-a788-f56d239a82be (9ee46b7a-1208-464e-a788-f56d239a82be): created successfully Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34292e31-469c-4c46-92a0-e72f9b179551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Flow 'volume_create_manager' (7b16bc91-49f8-4758-811f-ed70102901a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7de415c5-e866-4086-af6a-b68faacda533 tempest-TestInstancesWithCinderVolumes-1463220248 None] Created volume successfully. Nov 03 07:46:25 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" returned: 0 in 8.037s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:46:25 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Converted 1024.00 MB image at 127.39 MB/s Nov 03 07:46:25 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a is being set with open permissions: ugo+rw Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:25 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a Nov 03 07:46:25 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:25 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" released by "_copy_volume_from_snapshot" :: held 9.314s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-d3911cba-2365-401d-a855-71e1259090f6-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" released by "_create_volume_from_snapshot" :: held 9.391s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.418s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60fe044-78d0-4b86-84e0-9182392ae113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a', 'volume_size': 2, 'snapshot_id': 'd3911cba-2365-401d-a855-71e1259090f6'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe380f4-742f-426b-9a3f-11ee4b3e02d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a (04af5338-e6c6-4f74-b234-9cb5b41c3e1a): created successfully Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe380f4-742f-426b-9a3f-11ee4b3e02d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (659a843a-bf81-43eb-b246-b0da6b741b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b2a7a303-4a31-41b0-9500-87a5868fff02 tempest-VolumesSnapshotTestJSON-1663042263 None] Created volume successfully. Nov 03 07:46:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-04af5338-e6c6-4f74-b234-9cb5b41c3e1a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-04af5338-e6c6-4f74-b234-9cb5b41c3e1a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec866010-4fdb-4716-8d2e-23c60b06b11c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:26 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a Nov 03 07:46:26 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:27 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a Nov 03 07:46:27 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" returned: 0 in 0.293s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-04af5338-e6c6-4f74-b234-9cb5b41c3e1a" released by "delete_volume" :: held 0.805s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['bd89cdf6-fd16-4f42-85f5-a7e936b68d9f', '9ed47da8-7904-4df5-a8f8-f70c4bbc0347', '13115dee-5bc5-42dc-8c97-b65259ed0461', '572df195-9565-46e9-b632-8aa0b5f9e571'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:27 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:46:27 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-d3911cba-2365-401d-a855-71e1259090f6-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-d3911cba-2365-401d-a855-71e1259090f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:27 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Deleted volume successfully. Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-d3911cba-2365-401d-a855-71e1259090f6" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f196759f-e9db-4482-8aa1-0007aa61d905 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-04af5338-e6c6-4f74-b234-9cb5b41c3e1a-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-d3911cba-2365-401d-a855-71e1259090f6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Deleting offline snapshot d3911cba-2365-401d-a855-71e1259090f6 of volume 7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] snapshot_file for this snap is: volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e0e348-e882-4aab-b812-12fbc5103e7e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:28 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 Nov 03 07:46:28 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:28 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6" returned: 0 in 0.511s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04f8a3-18d7-4fda-b56c-9a17fa6969a1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6829d565-3223-496b-bdfd-209fbafa5044 req-2d64bea5-2765-47ff-a9fb-f6413a77fa81 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6829d565-3223-496b-bdfd-209fbafa5044 req-2d64bea5-2765-47ff-a9fb-f6413a77fa81 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:28 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 Nov 03 07:46:28 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6829d565-3223-496b-bdfd-209fbafa5044 req-2d64bea5-2765-47ff-a9fb-f6413a77fa81 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6829d565-3223-496b-bdfd-209fbafa5044 req-2d64bea5-2765-47ff-a9fb-f6413a77fa81 tempest-TestInstancesWithCinderVolumes-1463220248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-9ee46b7a-1208-464e-a788-f56d239a82be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0a2e9d1-aa1f-4db1-9687-a0acb9b459e5', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:46:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6829d565-3223-496b-bdfd-209fbafa5044 req-2d64bea5-2765-47ff-a9fb-f6413a77fa81 tempest-TestInstancesWithCinderVolumes-1463220248 None] attachment_update completed successfully. Nov 03 07:46:29 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:29 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 Nov 03 07:46:29 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:29 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6" returned: 0 in 0.464s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:29 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6 Nov 03 07:46:29 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:30 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5.d3911cba-2365-401d-a855-71e1259090f6" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-d3911cba-2365-401d-a855-71e1259090f6" released by "_delete_snapshot" :: held 2.326s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" released by "delete_snapshot" :: held 2.364s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['aa620188-b273-4b2b-b558-2c2275774159', '76f407d0-7731-468b-8285-e0d00b923a53', '59b9e1e7-aedc-475c-9b6e-1e2d41881df5', '8cc618fa-e7a2-4067-a0c0-16f42b7c7208'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Delete snapshot completed successfully. Nov 03 07:46:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ce6d18-353a-4ed8-8c8b-5645f35ef31a tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-d3911cba-2365-401d-a855-71e1259090f6-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb30aa2-903a-479b-baf2-a5cc1dbb450f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:31 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 Nov 03 07:46:31 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:31 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:31 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5 Nov 03 07:46:31 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5" released by "delete_volume" :: held 0.892s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['33162a31-5898-4da8-96c1-b7fb120bf198', '020ac990-4166-49f3-b230-5ad46c48e3fc', '3bc1a2a0-9710-456b-a226-37088f3adaa4', '430ce0c3-6efd-48c3-82d8-0773fcd44ea2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:32 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:46:32 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:32 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Deleted volume successfully. Nov 03 07:46:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3807b152-7a01-4c9d-b997-5d848585773e tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-7b5c0a64-8e8d-4a41-aac1-17faa065f2f5-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (1b502ca3-b017-4955-8b2c-71139ff8747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6699bf0-e27e-45f1-b228-7cb091df7a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6699bf0-e27e-45f1-b228-7cb091df7a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1757140935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a112268-ebf4-4f09-a2d4-3d99d5ad78ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:33Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0318a45-085e-4ce4-9d77-81b5de718095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0318a45-085e-4ce4-9d77-81b5de718095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfbd71d-5cf2-4dfa-9261-b26793c5502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfbd71d-5cf2-4dfa-9261-b26793c5502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a112268-ebf4-4f09-a2d4-3d99d5ad78ac', 'volume_name': 'volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1653bca5-6b93-4db0-8f10-914c4de6fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1653bca5-6b93-4db0-8f10-914c4de6fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3791da-988b-48a5-a580-d021ee0b67ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume 1a112268-ebf4-4f09-a2d4-3d99d5ad78ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac', 'volume_size': 1} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1757140935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a112268-ebf4-4f09-a2d4-3d99d5ad78ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:33Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating volume 1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:46:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:33 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac 1073741824 Nov 03 07:46:33 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac 1073741824" returned: 0 in 1.009s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac Nov 03 07:46:34 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:46:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3791da-988b-48a5-a580-d021ee0b67ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886b723d-c68e-48ce-97a0-95947cca89ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac (1a112268-ebf4-4f09-a2d4-3d99d5ad78ac): created successfully Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886b723d-c68e-48ce-97a0-95947cca89ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (1b502ca3-b017-4955-8b2c-71139ff8747f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a082038d-19c5-4bbe-b22d-1b51f406f297 tempest-VolumesSnapshotTestJSON-1663042263 None] Created volume successfully. Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating offline snapshot 5c83fee1-5f54-4a78-bef7-d173fc276b3a of volume 1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8a60a-5f14-497b-9cbf-d32aaf2fe65f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac Nov 03 07:46:36 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:36 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:36 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a 1G Nov 03 07:46:36 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:37 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a 1G" returned: 0 in 0.818s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:37 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a Nov 03 07:46:37 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:37 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a" returned: 0 in 0.554s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:37 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a is being set with open permissions: ugo+rw Nov 03 07:46:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:37 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a Nov 03 07:46:37 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:38 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:38 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info Nov 03 07:46:38 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:38 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info" returned: 0 in 0.453s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info is being set with open permissions: ugo+rw Nov 03 07:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:38 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info Nov 03 07:46:38 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:39 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.info" returned: 0 in 0.525s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.500s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-47347fca-fdea-4e19-8c6c-b72e4e466613 tempest-VolumesSnapshotTestJSON-1663042263 None] Create snapshot completed successfully Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (a1af7837-f753-4297-a021-91971711eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb052ff2-f67c-4050-bf5e-459fe65f2deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb052ff2-f67c-4050-bf5e-459fe65f2deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1486346967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d4db4c-edff-4800-b580-49bd8fb7e360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf777012d4c482f9d00fc01d37b1459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c83fee1-5f54-4a78-bef7-d173fc276b3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:41Z,use_quota=True,user_id='1fb82aa33e294c27a1e5d0a9ecfe427a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4837e7e-4775-4005-bfe1-a4ad886731f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4837e7e-4775-4005-bfe1-a4ad886731f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8ffa8c-af65-4a82-b2bd-4732cbbd1002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8ffa8c-af65-4a82-b2bd-4732cbbd1002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c8d4db4c-edff-4800-b580-49bd8fb7e360', 'volume_name': 'volume-c8d4db4c-edff-4800-b580-49bd8fb7e360', 'volume_size': 1, 'snapshot_id': '5c83fee1-5f54-4a78-bef7-d173fc276b3a'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d390701c-fd62-4270-808d-64c624e052e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d390701c-fd62-4270-808d-64c624e052e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f29a96-f9d0-4e46-b172-8abb1ca2e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume c8d4db4c-edff-4800-b580-49bd8fb7e360: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c8d4db4c-edff-4800-b580-49bd8fb7e360', 'volume_size': 1, 'snapshot_id': '5c83fee1-5f54-4a78-bef7-d173fc276b3a'} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-5c83fee1-5f54-4a78-bef7-d173fc276b3a-c8d4db4c-edff-4800-b580-49bd8fb7e360" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-5c83fee1-5f54-4a78-bef7-d173fc276b3a-c8d4db4c-edff-4800-b580-49bd8fb7e360" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating volume c8d4db4c-edff-4800-b580-49bd8fb7e360 from snapshot 5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-c8d4db4c-edff-4800-b580-49bd8fb7e360" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-c8d4db4c-edff-4800-b580-49bd8fb7e360" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] snapshot: 5c83fee1-5f54-4a78-bef7-d173fc276b3a, volume: c8d4db4c-edff-4800-b580-49bd8fb7e360, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[842d5eb3-8980-412d-a8c9-29192a4ba839]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:41 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a Nov 03 07:46:41 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:42 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a" returned: 0 in 0.701s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bef8e4-2d69-440a-847a-e9902db747dc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:42 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac Nov 03 07:46:42 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:42 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" returned: 0 in 0.535s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:46:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:42 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 Nov 03 07:46:42 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:51 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=37,cinder:INSERT=14,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:51 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=37,cinder:INSERT=11,cinder:SELECT=42,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:52 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360" returned: 0 in 9.863s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:52 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac, size 1024.00 MB, duration 9.87 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:46:52 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Converted 1024.00 MB image at 103.79 MB/s Nov 03 07:46:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 is being set with open permissions: ugo+rw Nov 03 07:46:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:52 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 Nov 03 07:46:52 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:53 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360" returned: 0 in 0.624s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-c8d4db4c-edff-4800-b580-49bd8fb7e360" released by "_copy_volume_from_snapshot" :: held 11.875s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-5c83fee1-5f54-4a78-bef7-d173fc276b3a-c8d4db4c-edff-4800-b580-49bd8fb7e360" released by "_create_volume_from_snapshot" :: held 12.016s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.047s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f29a96-f9d0-4e46-b172-8abb1ca2e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d4db4c-edff-4800-b580-49bd8fb7e360', 'volume_size': 1, 'snapshot_id': '5c83fee1-5f54-4a78-bef7-d173fc276b3a'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10e6d40-b8c4-4154-9a26-33abf3bf8e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Volume volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 (c8d4db4c-edff-4800-b580-49bd8fb7e360): created successfully Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10e6d40-b8c4-4154-9a26-33abf3bf8e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Flow 'volume_create_manager' (a1af7837-f753-4297-a021-91971711eda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cc34c93b-3119-40a0-af3a-6410e0898a87 tempest-VolumesSnapshotTestJSON-1663042263 None] Created volume successfully. Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-c8d4db4c-edff-4800-b580-49bd8fb7e360-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-c8d4db4c-edff-4800-b580-49bd8fb7e360-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-c8d4db4c-edff-4800-b580-49bd8fb7e360" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-c8d4db4c-edff-4800-b580-49bd8fb7e360" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ce99b-eb9d-46a3-aaed-46c547e42c4c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:46:54 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 Nov 03 07:46:54 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:54 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360" returned: 0 in 0.527s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:54 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360 Nov 03 07:46:54 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:55 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8d4db4c-edff-4800-b580-49bd8fb7e360" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-c8d4db4c-edff-4800-b580-49bd8fb7e360" released by "delete_volume" :: held 0.984s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['d131d101-c287-4e6b-aad1-e6adddc087d6', '007709e3-7aff-48ca-b3b5-ac7b5f2e1e85', '8c080422-f47b-4419-b730-b87acd3a29c3', 'c4fbd82f-e988-4f54-8191-cbfc3bf2a314'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:55 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:46:55 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:55 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Deleted volume successfully. Nov 03 07:46:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6167bb79-0268-40c2-b256-95dc85f2ac15 tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-c8d4db4c-edff-4800-b580-49bd8fb7e360-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-5c83fee1-5f54-4a78-bef7-d173fc276b3a-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-5c83fee1-5f54-4a78-bef7-d173fc276b3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-5c83fee1-5f54-4a78-bef7-d173fc276b3a" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-5c83fee1-5f54-4a78-bef7-d173fc276b3a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Deleting offline snapshot 5c83fee1-5f54-4a78-bef7-d173fc276b3a of volume 1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] snapshot_file for this snap is: volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed94e638-d1ce-4458-91cc-c661df90d752]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:56 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a Nov 03 07:46:56 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:56 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bebfc9-41a2-4909-bf22-2fce0c77d548]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:57 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac Nov 03 07:46:57 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:57 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" returned: 0 in 0.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:57 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a Nov 03 07:46:57 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:57 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:57 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a Nov 03 07:46:57 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:58 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac.5c83fee1-5f54-4a78-bef7-d173fc276b3a" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-5c83fee1-5f54-4a78-bef7-d173fc276b3a" released by "_delete_snapshot" :: held 1.708s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" released by "delete_snapshot" :: held 1.737s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['98ca00e7-5170-4c06-bbe4-7388bf3187f6', '43854320-00ea-4fa3-89d8-15859c6c9e37', '8ddbf69f-dd12-43d2-83ae-6207bfed0900', '7e35834b-69aa-442a-b7c3-22cbf5ae7a08'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Delete snapshot completed successfully. Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8d0ed44-f441-445d-a695-546ffc77af2f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-5c83fee1-5f54-4a78-bef7-d173fc276b3a-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[85085546-7f98-4043-9a85-a9050e65199f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:58 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac Nov 03 07:46:58 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac Nov 03 07:46:59 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac" released by "delete_volume" :: held 0.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['6471c0b2-bf04-4e11-9164-22611d452759', 'fc0e693b-bfa2-4047-bf72-d1cfffee457d', 'bf01dee3-5fc7-4895-8fb3-f0a7b075bddc', 'd1519e74-3446-4eb3-8872-9eaa69a8582f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:46:59 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Deleted volume successfully. Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9c30988e-eb56-4f28-91a5-451ea9dde76f tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-1a112268-ebf4-4f09-a2d4-3d99d5ad78ac-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-b9904b12-b814-4947-90f7-4210064de41c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-b9904b12-b814-4947-90f7-4210064de41c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "cinder-quobyte-b9904b12-b814-4947-90f7-4210064de41c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-b9904b12-b814-4947-90f7-4210064de41c" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1681d1f3-48bb-463b-ad0d-3661706ddd18]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c Nov 03 07:47:00 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:00 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c Nov 03 07:47:00 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:00 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b9904b12-b814-4947-90f7-4210064de41c" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-quobyte-b9904b12-b814-4947-90f7-4210064de41c" released by "delete_volume" :: held 0.716s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Created reservations ['85806c01-1377-4621-871b-5fb7a8353569', '3e5f0fbb-d081-40a2-a5aa-8eef327f4dea', '95418f34-36f5-46de-8683-d23c27fbdc51', 'fd2981c8-4cdb-48de-824a-ee5c114b673a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:01 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:01 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Deleted volume successfully. Nov 03 07:47:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad70931c-f3c5-4c6e-9145-d87a6e02806d tempest-VolumesSnapshotTestJSON-1663042263 None] Lock "cinder-b9904b12-b814-4947-90f7-4210064de41c-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Flow 'volume_create_manager' (ac60b1cb-3062-4001-b319-8202bd6aaafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ab1845-0c09-4287-8468-3a9b1815b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ab1845-0c09-4287-8468-3a9b1815b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-489723067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b7fa22-08c4-45b3-a3a0-f78c6260529a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a501b7ab5c404487911b034e802dbd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:06Z,use_quota=True,user_id='e7509c8ac62c4e6ab4a8d101181d87bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bcd2a8-4083-4780-93a8-9a09874df512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bcd2a8-4083-4780-93a8-9a09874df512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e1186-c58c-4f45-836e-b5935042a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e1186-c58c-4f45-836e-b5935042a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b7fa22-08c4-45b3-a3a0-f78c6260529a', 'volume_name': 'volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6325c8-9db3-41b6-a462-361ab8407aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6325c8-9db3-41b6-a462-361ab8407aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d00d09-4dc0-4040-a6c1-db3f6d135e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Volume e7b7fa22-08c4-45b3-a3a0-f78c6260529a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a', 'volume_size': 1} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-489723067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b7fa22-08c4-45b3-a3a0-f78c6260529a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a501b7ab5c404487911b034e802dbd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:06Z,use_quota=True,user_id='e7509c8ac62c4e6ab4a8d101181d87bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Creating volume e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:06 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a 1073741824 Nov 03 07:47:06 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:06 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a 1073741824" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:06 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a Nov 03 07:47:06 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:07 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d00d09-4dc0-4040-a6c1-db3f6d135e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8cd101-cc95-483e-b692-c4e2bc498fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Volume volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a (e7b7fa22-08c4-45b3-a3a0-f78c6260529a): created successfully Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8cd101-cc95-483e-b692-c4e2bc498fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Flow 'volume_create_manager' (ac60b1cb-3062-4001-b319-8202bd6aaafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0177d39-8ece-4ecf-a2a4-e50a54288624 tempest-TestStampPattern-1143860099 None] Created volume successfully. Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (e6baaac3-5e8b-422f-bce1-e8d0bacf980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d37f67-451e-4648-8aab-a80aee962593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d37f67-451e-4648-8aab-a80aee962593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-358517475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a70d3f-a681-435a-ac06-e4e50cf1b3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:10Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0ee28f-c100-4a31-b341-894d86d94283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0ee28f-c100-4a31-b341-894d86d94283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4870966-5f47-42bb-a845-497f3fe12cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4870966-5f47-42bb-a845-497f3fe12cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a70d3f-a681-435a-ac06-e4e50cf1b3fb', 'volume_name': 'volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f2dc51-a354-46d1-9c63-75f41cc606cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f2dc51-a354-46d1-9c63-75f41cc606cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f64aed7-a663-4437-965f-654e6e330693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume 79a70d3f-a681-435a-ac06-e4e50cf1b3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb', 'volume_size': 1} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-358517475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a70d3f-a681-435a-ac06-e4e50cf1b3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:10Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Creating volume 79a70d3f-a681-435a-ac06-e4e50cf1b3fb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:10 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb 1073741824 Nov 03 07:47:10 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-1e28bf94-d9bd-421c-9551-33cef85bbcab req-62b79785-175a-44bb-ae6e-5c7f5b89e0a1 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:10 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb 1073741824" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:10 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb Nov 03 07:47:10 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:11 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb" returned: 0 in 0.293s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-1e28bf94-d9bd-421c-9551-33cef85bbcab req-62b79785-175a-44bb-ae6e-5c7f5b89e0a1 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.761s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f64aed7-a663-4437-965f-654e6e330693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597315ec-8cea-4d30-8182-0cd03f970abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-1e28bf94-d9bd-421c-9551-33cef85bbcab req-62b79785-175a-44bb-ae6e-5c7f5b89e0a1 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb (79a70d3f-a681-435a-ac06-e4e50cf1b3fb): created successfully Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597315ec-8cea-4d30-8182-0cd03f970abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (e6baaac3-5e8b-422f-bce1-e8d0bacf980d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b5d8b0a3-9199-4112-ae94-d26bf70c87c7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created volume successfully. Nov 03 07:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-1e28bf94-d9bd-421c-9551-33cef85bbcab req-62b79785-175a-44bb-ae6e-5c7f5b89e0a1 tempest-TestInstancesWithCinderVolumes-1463220248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a4cbd6e-8d85-45d9-838b-2cfc06aa320c', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:47:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-1e28bf94-d9bd-421c-9551-33cef85bbcab req-62b79785-175a-44bb-ae6e-5c7f5b89e0a1 tempest-TestInstancesWithCinderVolumes-1463220248 None] attachment_update completed successfully. Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (96a856cf-fa48-4f0b-be2a-8a0eb36ef4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e0c974-41eb-4349-87b9-e105f37acd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e0c974-41eb-4349-87b9-e105f37acd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519466312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01cb56a-2120-4aa4-8bd1-fa3292caa0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:13Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12182fb5-84a5-4339-9131-16d81c8b27f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12182fb5-84a5-4339-9131-16d81c8b27f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd16dff-a0b0-4729-b671-ee18de22a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd16dff-a0b0-4729-b671-ee18de22a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01cb56a-2120-4aa4-8bd1-fa3292caa0e7', 'volume_name': 'volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d7f8c-cf41-4e66-83ec-6af95f4fb169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d7f8c-cf41-4e66-83ec-6af95f4fb169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e0faaa-116f-4898-b13e-8df80cfd63fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume e01cb56a-2120-4aa4-8bd1-fa3292caa0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7', 'volume_size': 1} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519466312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01cb56a-2120-4aa4-8bd1-fa3292caa0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:13Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Creating volume e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:13 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 1073741824 Nov 03 07:47:13 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (1969b163-e440-4757-b21c-c1e7a055ef43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a74e9-2885-4fcc-9ffb-e62708f55af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a74e9-2885-4fcc-9ffb-e62708f55af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562824771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88966a47-4cc8-4187-9289-f9799e75442d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:14Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0251f9a7-532d-4dcd-ac08-5602b7e9fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0251f9a7-532d-4dcd-ac08-5602b7e9fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29193e05-d9ce-4960-8431-47269f61fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29193e05-d9ce-4960-8431-47269f61fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88966a47-4cc8-4187-9289-f9799e75442d', 'volume_name': 'volume-88966a47-4cc8-4187-9289-f9799e75442d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e40dc28-7ed0-4f1c-8881-38a9240191d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e40dc28-7ed0-4f1c-8881-38a9240191d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499f146-dfb3-45af-be0b-0f60747104a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume 88966a47-4cc8-4187-9289-f9799e75442d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88966a47-4cc8-4187-9289-f9799e75442d', 'volume_size': 1} Nov 03 07:47:14 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 1073741824" returned: 0 in 0.907s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:14 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 Nov 03 07:47:14 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-523220c6-cb11-41b5-b313-c308c6a64a71 req-0e5ad256-4cd2-4911-b87f-39b18a0fae93 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:14 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (24b64257-26e7-47a0-a2ce-169fd91dbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a573da13-5a8f-4ac1-961d-75e0d80f66e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562824771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88966a47-4cc8-4187-9289-f9799e75442d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:14Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Creating volume 88966a47-4cc8-4187-9289-f9799e75442d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a573da13-5a8f-4ac1-961d-75e0d80f66e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547374545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b30cf8e-da9e-41dc-adc2-7814c56c362e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:15Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d 1073741824 Nov 03 07:47:14 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bba34a-a5fc-4016-b9a1-ed585f73797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bba34a-a5fc-4016-b9a1-ed585f73797c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ac21b3-02c9-4562-ae14-bc7414a5eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ac21b3-02c9-4562-ae14-bc7414a5eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b30cf8e-da9e-41dc-adc2-7814c56c362e', 'volume_name': 'volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12d23a6-e85f-47c7-9855-49df6dc6c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12d23a6-e85f-47c7-9855-49df6dc6c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f16dd9-1485-4816-aca9-18cbe04d5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume 1b30cf8e-da9e-41dc-adc2-7814c56c362e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e', 'volume_size': 1} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e0faaa-116f-4898-b13e-8df80cfd63fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6332d187-2d59-4425-8e73-cd10aaa99a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 (e01cb56a-2120-4aa4-8bd1-fa3292caa0e7): created successfully Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6332d187-2d59-4425-8e73-cd10aaa99a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (96a856cf-fa48-4f0b-be2a-8a0eb36ef4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-def02ad3-9a1d-4963-87fc-ed063df878c9 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created volume successfully. Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (b94c477f-1bac-41bb-a48c-f2c12be82e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad514512-e411-41d8-b25e-88e6e99cec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad514512-e411-41d8-b25e-88e6e99cec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-63164289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f137c02-b66a-40c5-92fa-03a210f95609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:15Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee12d0f-3996-4904-ac85-057aa1c78f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee12d0f-3996-4904-ac85-057aa1c78f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e965667a-042d-431f-b089-102777dfb2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e965667a-042d-431f-b089-102777dfb2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f137c02-b66a-40c5-92fa-03a210f95609', 'volume_name': 'volume-3f137c02-b66a-40c5-92fa-03a210f95609', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b56958-22e5-45dd-9dbc-2fb5dc49adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b56958-22e5-45dd-9dbc-2fb5dc49adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17a5980-9cd0-4124-bc79-399abf8feaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume 3f137c02-b66a-40c5-92fa-03a210f95609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f137c02-b66a-40c5-92fa-03a210f95609', 'volume_size': 1} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:15 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d 1073741824" returned: 0 in 0.926s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:15 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d Nov 03 07:47:15 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (06a36ceb-6321-4ccc-8500-704ac5601e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf27d01-9772-4b3f-9ab2-34d665232e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf27d01-9772-4b3f-9ab2-34d665232e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565220538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47199a6a-0eb4-4c5b-883e-c275770b25e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:16Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9ab8ad-647a-4a14-a65f-940a1342b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9ab8ad-647a-4a14-a65f-940a1342b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcdffe3-ea7d-4778-9996-41f1b154a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcdffe3-ea7d-4778-9996-41f1b154a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47199a6a-0eb4-4c5b-883e-c275770b25e6', 'volume_name': 'volume-47199a6a-0eb4-4c5b-883e-c275770b25e6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96f9508-24fc-499b-ad79-1eb725f92888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96f9508-24fc-499b-ad79-1eb725f92888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aafdd0-aeac-4a43-a03f-9b56a10fb229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume 47199a6a-0eb4-4c5b-883e-c275770b25e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47199a6a-0eb4-4c5b-883e-c275770b25e6', 'volume_size': 1} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:16 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-523220c6-cb11-41b5-b313-c308c6a64a71 req-0e5ad256-4cd2-4911-b87f-39b18a0fae93 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.563s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499f146-dfb3-45af-be0b-0f60747104a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88966a47-4cc8-4187-9289-f9799e75442d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c637b06-1a4f-4c04-904d-a9fe4acdc971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-523220c6-cb11-41b5-b313-c308c6a64a71 req-0e5ad256-4cd2-4911-b87f-39b18a0fae93 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547374545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b30cf8e-da9e-41dc-adc2-7814c56c362e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:15Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Creating volume 1b30cf8e-da9e-41dc-adc2-7814c56c362e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume volume-88966a47-4cc8-4187-9289-f9799e75442d (88966a47-4cc8-4187-9289-f9799e75442d): created successfully Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c637b06-1a4f-4c04-904d-a9fe4acdc971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:16 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e 1073741824 Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (1969b163-e440-4757-b21c-c1e7a055ef43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:16 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e71df416-b84f-49f2-94ed-ca97a170edd2 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created volume successfully. Nov 03 07:47:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-523220c6-cb11-41b5-b313-c308c6a64a71 req-0e5ad256-4cd2-4911-b87f-39b18a0fae93 tempest-TestInstancesWithCinderVolumes-1463220248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-c14e1246-5918-4a70-8122-ffd71ef090a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2737c72-0a9d-444e-b8a4-7188a7715271', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:47:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-523220c6-cb11-41b5-b313-c308c6a64a71 req-0e5ad256-4cd2-4911-b87f-39b18a0fae93 tempest-TestInstancesWithCinderVolumes-1463220248 None] attachment_update completed successfully. Nov 03 07:47:17 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e 1073741824" returned: 0 in 0.818s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:17 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e Nov 03 07:47:17 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:17 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e" returned: 0 in 0.491s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-63164289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f137c02-b66a-40c5-92fa-03a210f95609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:15Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Creating volume 3f137c02-b66a-40c5-92fa-03a210f95609 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:17 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 1073741824 Nov 03 07:47:17 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f16dd9-1485-4816-aca9-18cbe04d5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efa17d1-e8ff-4e47-8af1-d539ecb513ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e (1b30cf8e-da9e-41dc-adc2-7814c56c362e): created successfully Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efa17d1-e8ff-4e47-8af1-d539ecb513ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (24b64257-26e7-47a0-a2ce-169fd91dbb91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bd8dcf5f-03e0-4737-a5cc-3faaee1e8cd8 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created volume successfully. Nov 03 07:47:18 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 1073741824" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:18 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 Nov 03 07:47:18 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:18 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565220538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47199a6a-0eb4-4c5b-883e-c275770b25e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6188c43d344102823e7747d51acaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:16Z,use_quota=True,user_id='dc36f1d5466a4d29bc21e299301f9720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Creating volume 47199a6a-0eb4-4c5b-883e-c275770b25e6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17a5980-9cd0-4124-bc79-399abf8feaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f137c02-b66a-40c5-92fa-03a210f95609', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960b0366-78a9-4d33-96d9-b8df75c6fee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:18 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 1073741824 Nov 03 07:47:18 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume volume-3f137c02-b66a-40c5-92fa-03a210f95609 (3f137c02-b66a-40c5-92fa-03a210f95609): created successfully Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960b0366-78a9-4d33-96d9-b8df75c6fee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (b94c477f-1bac-41bb-a48c-f2c12be82e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ffe09a4d-b9cf-41a0-8d0a-fa16610e889d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created volume successfully. Nov 03 07:47:19 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 1073741824" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:19 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 Nov 03 07:47:19 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:19 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aafdd0-aeac-4a43-a03f-9b56a10fb229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47199a6a-0eb4-4c5b-883e-c275770b25e6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933ec308-b8b5-4ddb-8646-9d59780c862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Volume volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 (47199a6a-0eb4-4c5b-883e-c275770b25e6): created successfully Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933ec308-b8b5-4ddb-8646-9d59780c862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Flow 'volume_create_manager' (06a36ceb-6321-4ccc-8500-704ac5601e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-11edd3f4-78ba-4989-aa9e-dac0f76ea448 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created volume successfully. Nov 03 07:47:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-47199a6a-0eb4-4c5b-883e-c275770b25e6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-47199a6a-0eb4-4c5b-883e-c275770b25e6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-quobyte-47199a6a-0eb4-4c5b-883e-c275770b25e6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-47199a6a-0eb4-4c5b-883e-c275770b25e6" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ee6851-c477-4549-9f7c-f3a2174b8e16]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:20 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 Nov 03 07:47:20 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:21 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:21 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6 Nov 03 07:47:21 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:21 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-47199a6a-0eb4-4c5b-883e-c275770b25e6" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-47199a6a-0eb4-4c5b-883e-c275770b25e6" released by "delete_volume" :: held 0.741s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created reservations ['56a9301c-25ce-4448-9cb7-2159dba6a9a1', '0a8c2027-f0e4-4528-a8d0-9dafa1716f91', '2957defe-d7ff-4494-ba1f-1f8162eb2aac', '47b54d93-93f0-493a-b203-664325cafec6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:21 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:21 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-3f137c02-b66a-40c5-92fa-03a210f95609-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-3f137c02-b66a-40c5-92fa-03a210f95609-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-quobyte-3f137c02-b66a-40c5-92fa-03a210f95609" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:22 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-3f137c02-b66a-40c5-92fa-03a210f95609" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Deleted volume successfully. Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6a0de-d8ef-45b1-a083-38047a3dbc03]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a99873c1-5826-416c-a5f3-61b655e0ed03 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-47199a6a-0eb4-4c5b-883e-c275770b25e6-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:22 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 Nov 03 07:47:22 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:22 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609" returned: 0 in 0.454s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:22 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609 Nov 03 07:47:22 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:22 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3f137c02-b66a-40c5-92fa-03a210f95609" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-3f137c02-b66a-40c5-92fa-03a210f95609" released by "delete_volume" :: held 0.796s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9b17bdb5-4ec3-4c5f-98fc-00bd0e1cfed7 req-3cf20581-1771-4fd7-959d-227866d0c9dc tempest-TestInstancesWithCinderVolumes-1463220248 None] Terminate volume connection completed successfully. Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-9b17bdb5-4ec3-4c5f-98fc-00bd0e1cfed7 req-3cf20581-1771-4fd7-959d-227866d0c9dc tempest-TestInstancesWithCinderVolumes-1463220248 None] Deleting attachment 2a4cbd6e-8d85-45d9-838b-2cfc06aa320c. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created reservations ['788131d1-a51c-4d40-8e78-0f9030f87201', 'f827240d-0997-4b37-b4b8-316b4101fe12', '8fbe9024-6773-4a94-b520-f8dee5bed9f1', '345d4185-94a9-4f93-b45b-aa350a0ff379'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:22 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:22 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-1b30cf8e-da9e-41dc-adc2-7814c56c362e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-1b30cf8e-da9e-41dc-adc2-7814c56c362e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-quobyte-1b30cf8e-da9e-41dc-adc2-7814c56c362e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-1b30cf8e-da9e-41dc-adc2-7814c56c362e" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518d818-ab37-4bcf-8e19-e858eff9baa4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:23 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Deleted volume successfully. Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bcfb8b46-29b8-4dad-8e82-d3eda7529126 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-3f137c02-b66a-40c5-92fa-03a210f95609-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:23 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e Nov 03 07:47:23 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "cinder-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "cinder-quobyte-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-quobyte-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[328169eb-6bcd-490a-a1ef-1aec88af7094]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:23 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:23 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e Nov 03 07:47:23 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:23 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e Nov 03 07:47:23 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:24 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-1b30cf8e-da9e-41dc-adc2-7814c56c362e" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-1b30cf8e-da9e-41dc-adc2-7814c56c362e" released by "delete_volume" :: held 0.819s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:24 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e" returned: 0 in 0.424s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created reservations ['1c931671-b2c7-43f4-bfb5-35ad813bea8d', 'ab652b2f-781c-409e-a545-70fd753319e2', '73d0da47-cfe0-4704-aa6e-1c3463d71699', '1fad147d-fdde-41a8-95dd-f5d5a99f32ec'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:24 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e Nov 03 07:47:24 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:24 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:24 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-88966a47-4cc8-4187-9289-f9799e75442d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-88966a47-4cc8-4187-9289-f9799e75442d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:24 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-quobyte-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e" released by "delete_volume" :: held 0.871s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-quobyte-88966a47-4cc8-4187-9289-f9799e75442d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-88966a47-4cc8-4187-9289-f9799e75442d" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:24 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021083219-1078278490 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021083219-1078278490, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:24 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021083219-1078278490 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021083219-1078278490, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3684c83-a72e-4c7c-9e2e-a93628b20e17]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Created reservations ['7c9f8dea-b4ec-42e6-a0a2-28a71daf168a', '9c5f7e31-02bd-4f1e-b58d-8fe96cdbe035', '7bfb16d9-d85c-4509-b059-85ae6d541d6a', '49e9a3f3-f3c8-4cc6-8f61-83ae4bcdbe42'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:24 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:24 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:24 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.528s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Deleted volume successfully. Nov 03 07:47:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89753b1d-2279-49dc-b410-14fb7237479d tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-1b30cf8e-da9e-41dc-adc2-7814c56c362e-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:24 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d Nov 03 07:47:24 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:25 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Deleted volume successfully. Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c0605961-6cae-482a-8a01-565468b8210b tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-e3b8cd11-4065-4e0b-bbd8-f534fe78bf4e-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:25 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d" returned: 0 in 0.548s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:25 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d Nov 03 07:47:25 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:25 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-88966a47-4cc8-4187-9289-f9799e75442d" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-88966a47-4cc8-4187-9289-f9799e75442d" released by "delete_volume" :: held 0.880s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created reservations ['6cc6c11c-2adf-4369-a53f-fd70d4e4f4d4', 'be86f943-35b8-4938-8f0a-b5f131a8d829', 'a9d5664a-8f91-43ea-b74a-4ebf26d3f0eb', 'd22756b2-2f5e-4650-af89-459e6e691038'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:25 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:25 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-quobyte-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[267cb0b7-b398-4e7a-92ee-2cc67871f9da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:25 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Deleted volume successfully. Nov 03 07:47:26 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 Nov 03 07:47:26 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2ad32a57-e497-4674-9d2e-961fd3466aed tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-88966a47-4cc8-4187-9289-f9799e75442d-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:26 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:26 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7 Nov 03 07:47:26 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:26 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7" released by "delete_volume" :: held 0.802s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created reservations ['2e603073-e228-4b97-9c3e-34ded18c8e58', 'dfd0bae0-f584-461b-a5b9-f508be9e5b33', '9d906648-0e73-4941-ba35-d6d267377918', '7a7f8fcc-b18a-4686-bb5f-b67b71addd5a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:26 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:26 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-79a70d3f-a681-435a-ac06-e4e50cf1b3fb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-79a70d3f-a681-435a-ac06-e4e50cf1b3fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "cinder-quobyte-79a70d3f-a681-435a-ac06-e4e50cf1b3fb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-79a70d3f-a681-435a-ac06-e4e50cf1b3fb" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:27 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e762681-6ecd-4163-9d5d-7305985684e7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Deleted volume successfully. Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa01b87-48d6-4b63-bdd2-f6b3a32b2112 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-e01cb56a-2120-4aa4-8bd1-fa3292caa0e7-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:27 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb Nov 03 07:47:27 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:27 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:27 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb Nov 03 07:47:27 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:27 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-79a70d3f-a681-435a-ac06-e4e50cf1b3fb" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-quobyte-79a70d3f-a681-435a-ac06-e4e50cf1b3fb" released by "delete_volume" :: held 0.766s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Created reservations ['5745441e-01ee-42a4-bf56-0adfc367da63', '7ad1e216-a2b0-4c4d-8038-20800b597df9', 'edb41ec0-3aae-4cef-af77-104e8b09800e', '6890f17a-8ed6-43b1-ae0b-5100a1a5b485'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:28 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:28 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f77e7c5b-8f9a-4b55-bbba-b6da71934085 req-4814761c-caf0-45f1-a039-5e921bda07ea tempest-TestInstancesWithCinderVolumes-1463220248 None] Terminate volume connection completed successfully. Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f77e7c5b-8f9a-4b55-bbba-b6da71934085 req-4814761c-caf0-45f1-a039-5e921bda07ea tempest-TestInstancesWithCinderVolumes-1463220248 None] Deleting attachment e2737c72-0a9d-444e-b8a4-7188a7715271. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:47:28 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Deleted volume successfully. Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6aa13326-fa58-42a3-a45d-ed13b66cd8d7 tempest-CreateVolumesFromSourceVolumeTest-260816681 None] Lock "cinder-79a70d3f-a681-435a-ac06-e4e50cf1b3fb-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "cinder-c14e1246-5918-4a70-8122-ffd71ef090a0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-c14e1246-5918-4a70-8122-ffd71ef090a0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "cinder-quobyte-c14e1246-5918-4a70-8122-ffd71ef090a0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-quobyte-c14e1246-5918-4a70-8122-ffd71ef090a0" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f4388-7c8e-4a0a-a6fd-b5d29eaacf52]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:29 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 Nov 03 07:47:29 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:29 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0" returned: 0 in 0.446s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:29 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0 Nov 03 07:47:29 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:29 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c14e1246-5918-4a70-8122-ffd71ef090a0" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-quobyte-c14e1246-5918-4a70-8122-ffd71ef090a0" released by "delete_volume" :: held 0.806s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:29 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-62565601-556405046 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-62565601-556405046, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:29 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-62565601-556405046 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-62565601-556405046, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Created reservations ['629f55e0-2f13-415a-9ffa-4c1e6edc6e14', '479d793c-6677-4c69-a005-66a4ddca04f8', '6d8a048e-9d22-4e44-af07-f63e95d386b3', 'b55062bf-26eb-4ae1-a5d0-bf8527e5114a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:29 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:29 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:30 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:30 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Deleted volume successfully. Nov 03 07:47:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c04075c5-b188-4f83-a685-7e7ae93880fb tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-c14e1246-5918-4a70-8122-ffd71ef090a0-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Flow 'volume_create_manager' (1bc4d352-9ce8-4396-86c8-643ae9e96827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c3cb85-c92e-4d95-9f4a-bb79f285f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c3cb85-c92e-4d95-9f4a-bb79f285f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724641326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b099c6f-f09c-401e-8f30-af801f6c8481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42bc87da8bb4a96ab6ce7a1e468da68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:33Z,use_quota=True,user_id='5b2efb518e924d3ea86cbf3f586f5223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f593007-8e43-4eaf-a419-743bcee7228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f593007-8e43-4eaf-a419-743bcee7228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4bf3c2-8788-4e26-b1c5-95957a380c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4bf3c2-8788-4e26-b1c5-95957a380c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b099c6f-f09c-401e-8f30-af801f6c8481', 'volume_name': 'volume-9b099c6f-f09c-401e-8f30-af801f6c8481', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e77e48e-3328-477d-a940-f1402cfae753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e77e48e-3328-477d-a940-f1402cfae753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7be5685-154c-4f17-ad0b-0910cde31193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Volume 9b099c6f-f09c-401e-8f30-af801f6c8481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b099c6f-f09c-401e-8f30-af801f6c8481', 'volume_size': 1} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724641326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b099c6f-f09c-401e-8f30-af801f6c8481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42bc87da8bb4a96ab6ce7a1e468da68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:33Z,use_quota=True,user_id='5b2efb518e924d3ea86cbf3f586f5223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Creating volume 9b099c6f-f09c-401e-8f30-af801f6c8481 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:32 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 1073741824 Nov 03 07:47:32 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:33 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 1073741824" returned: 0 in 0.625s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:33 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 Nov 03 07:47:33 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-3dab3ac1-8a31-407e-b896-c32b94556a89 req-4fcbdbba-dc8b-43bf-ae89-d08316f3befb tempest-TestInstancesWithCinderVolumes-1463220248 None] Terminate volume connection completed successfully. Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-3dab3ac1-8a31-407e-b896-c32b94556a89 req-4fcbdbba-dc8b-43bf-ae89-d08316f3befb tempest-TestInstancesWithCinderVolumes-1463220248 None] Deleting attachment d0a2e9d1-aa1f-4db1-9687-a0acb9b459e5. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:47:33 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7be5685-154c-4f17-ad0b-0910cde31193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b099c6f-f09c-401e-8f30-af801f6c8481', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c036763-0ad5-422c-a4e9-b63113d4fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Volume volume-9b099c6f-f09c-401e-8f30-af801f6c8481 (9b099c6f-f09c-401e-8f30-af801f6c8481): created successfully Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c036763-0ad5-422c-a4e9-b63113d4fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Flow 'volume_create_manager' (1bc4d352-9ce8-4396-86c8-643ae9e96827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5c3a5102-07cb-4f43-a3d8-d74f3ad7ae23 tempest-ProjectReaderTests-1324215994 None] Created volume successfully. Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "cinder-9ee46b7a-1208-464e-a788-f56d239a82be-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-9ee46b7a-1208-464e-a788-f56d239a82be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "cinder-quobyte-9ee46b7a-1208-464e-a788-f56d239a82be" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-quobyte-9ee46b7a-1208-464e-a788-f56d239a82be" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[010db18f-19a8-4eb7-9254-ff5c338c91a0]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:34 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be Nov 03 07:47:34 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:34 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:34 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be Nov 03 07:47:34 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Acquiring lock "cinder-9b099c6f-f09c-401e-8f30-af801f6c8481-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Lock "cinder-9b099c6f-f09c-401e-8f30-af801f6c8481-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Acquiring lock "cinder-quobyte-9b099c6f-f09c-401e-8f30-af801f6c8481" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Lock "cinder-quobyte-9b099c6f-f09c-401e-8f30-af801f6c8481" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:35 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9ee46b7a-1208-464e-a788-f56d239a82be" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-quobyte-9ee46b7a-1208-464e-a788-f56d239a82be" released by "delete_volume" :: held 0.655s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d971e3c6-bffd-47f0-afc4-c9b6bbb722a9]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:35 devstack cinder-volume[86916]: WARNING cinder.quota [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321037721-382627923 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321037721-382627923, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:35 devstack cinder-volume[86916]: WARNING cinder.quota [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321037721-382627923 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321037721-382627923, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Created reservations ['f94979ee-7e4d-435d-b15d-911a637891dd', '45d40ca8-b66a-4bee-b27a-7166fa1170f1', 'c05c9f26-2c7f-4f30-af04-e6828e4434d1', '2a83c1c1-ba84-4ec5-8386-60e5f6642f3a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:35 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 Nov 03 07:47:35 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:35 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:35 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:35 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:35 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:35 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481 Nov 03 07:47:35 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Deleted volume successfully. Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-207a1cc3-98d6-4b77-b467-59c2f7172619 tempest-TestInstancesWithCinderVolumes-1463220248 None] Lock "cinder-9ee46b7a-1208-464e-a788-f56d239a82be-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:35 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9b099c6f-f09c-401e-8f30-af801f6c8481" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Lock "cinder-quobyte-9b099c6f-f09c-401e-8f30-af801f6c8481" released by "delete_volume" :: held 0.686s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Created reservations ['72805cc6-dc06-4616-bb63-3c5af305bf92', 'df9a6ae3-4a05-422b-bf94-9120f344f05b', 'dd89a9bd-31e7-4968-bae0-b911fb94c96e', '627e0692-6ee4-4b9b-9824-e86f6b0d1865'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:35 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:35 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:36 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Deleted volume successfully. Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9735980d-e010-4238-ac67-567fedafafa0 tempest-ProjectReaderTests-1324215994 None] Lock "cinder-9b099c6f-f09c-401e-8f30-af801f6c8481-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Flow 'volume_create_manager' (9f0dbfc0-4f4c-4393-87c3-2635cbf969d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66299105-2f62-4f85-a5ce-cc810e2f60ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66299105-2f62-4f85-a5ce-cc810e2f60ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993511425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbeef816-e15f-45e3-bd79-4162c54d29ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42bc87da8bb4a96ab6ce7a1e468da68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:37Z,use_quota=True,user_id='5b2efb518e924d3ea86cbf3f586f5223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92d99a4-13e9-4a05-9aef-9838ac5555f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92d99a4-13e9-4a05-9aef-9838ac5555f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0394907-cf3f-43df-a4af-69b29f020425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0394907-cf3f-43df-a4af-69b29f020425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbeef816-e15f-45e3-bd79-4162c54d29ca', 'volume_name': 'volume-bbeef816-e15f-45e3-bd79-4162c54d29ca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b33012-cd44-43c2-9276-cb68eef45422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b33012-cd44-43c2-9276-cb68eef45422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3168e432-e9a8-450c-aa3f-f8c62c357bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Volume bbeef816-e15f-45e3-bd79-4162c54d29ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbeef816-e15f-45e3-bd79-4162c54d29ca', 'volume_size': 1} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993511425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbeef816-e15f-45e3-bd79-4162c54d29ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42bc87da8bb4a96ab6ce7a1e468da68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:37Z,use_quota=True,user_id='5b2efb518e924d3ea86cbf3f586f5223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Creating volume bbeef816-e15f-45e3-bd79-4162c54d29ca {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:47:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:36 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca 1073741824 Nov 03 07:47:36 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:37 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca 1073741824" returned: 0 in 0.446s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:37 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca Nov 03 07:47:37 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:37 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3168e432-e9a8-450c-aa3f-f8c62c357bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbeef816-e15f-45e3-bd79-4162c54d29ca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5007fd2c-ec1f-4bc5-93cd-3fd8a28d79b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Volume volume-bbeef816-e15f-45e3-bd79-4162c54d29ca (bbeef816-e15f-45e3-bd79-4162c54d29ca): created successfully Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5007fd2c-ec1f-4bc5-93cd-3fd8a28d79b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Flow 'volume_create_manager' (9f0dbfc0-4f4c-4393-87c3-2635cbf969d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3d4516fc-419d-4376-b676-3baf0ba1eb7e tempest-ProjectReaderTests-1324215994 None] Created volume successfully. Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Acquiring lock "cinder-bbeef816-e15f-45e3-bd79-4162c54d29ca-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Lock "cinder-bbeef816-e15f-45e3-bd79-4162c54d29ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Acquiring lock "cinder-quobyte-bbeef816-e15f-45e3-bd79-4162c54d29ca" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Lock "cinder-quobyte-bbeef816-e15f-45e3-bd79-4162c54d29ca" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b3424f-0489-4324-8ce4-6e45bd0a1441]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:37 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca Nov 03 07:47:37 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:38 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:38 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca Nov 03 07:47:38 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:38 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bbeef816-e15f-45e3-bd79-4162c54d29ca" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Lock "cinder-quobyte-bbeef816-e15f-45e3-bd79-4162c54d29ca" released by "delete_volume" :: held 0.666s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Created reservations ['2f77619e-c360-48bd-a546-e6670a0e026f', '1e4b3fed-af56-45ff-9633-e5344da9010a', 'd506096f-3b07-4fc6-986d-6d53019e770e', '841414a2-bb4a-447c-9c24-d8576af33106'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:38 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:38 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:38 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Deleted volume successfully. Nov 03 07:47:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2bc4f1d2-7081-4571-a777-9a9f27860b0d tempest-ProjectReaderTests-1324215994 None] Lock "cinder-bbeef816-e15f-45e3-bd79-4162c54d29ca-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6eb8423d-8aee-4f1d-94e9-73ff28b2403f req-b5ac51de-a82b-4e27-94a3-15d19a589181 tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6eb8423d-8aee-4f1d-94e9-73ff28b2403f req-b5ac51de-a82b-4e27-94a3-15d19a589181 tempest-TestStampPattern-1143860099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6eb8423d-8aee-4f1d-94e9-73ff28b2403f req-b5ac51de-a82b-4e27-94a3-15d19a589181 tempest-TestStampPattern-1143860099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6eb8423d-8aee-4f1d-94e9-73ff28b2403f req-b5ac51de-a82b-4e27-94a3-15d19a589181 tempest-TestStampPattern-1143860099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c1674c8-ca90-4034-a8d0-d1a182fcbbd1', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:47:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6eb8423d-8aee-4f1d-94e9-73ff28b2403f req-b5ac51de-a82b-4e27-94a3-15d19a589181 tempest-TestStampPattern-1143860099 None] attachment_update completed successfully. Nov 03 07:47:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-579b0423-9b6d-42d8-9dbb-2c067e714c59 req-ad6105c7-70b3-42cd-8ac4-8679c82bdddf tempest-TestStampPattern-1143860099 None] Terminate volume connection completed successfully. Nov 03 07:47:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-579b0423-9b6d-42d8-9dbb-2c067e714c59 req-ad6105c7-70b3-42cd-8ac4-8679c82bdddf tempest-TestStampPattern-1143860099 None] Deleting attachment 1c1674c8-ca90-4034-a8d0-d1a182fcbbd1. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Creating offline snapshot 6cf15fd4-eecc-449c-8754-ec46409ecb87 of volume e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf9fdbc-f985-4a42-b2fd-b2517cb68239]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:47 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a Nov 03 07:47:47 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:47 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:47 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 1G Nov 03 07:47:47 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:48 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 1G" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:48 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 Nov 03 07:47:48 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:48 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:48 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 is being set with open permissions: ugo+rw Nov 03 07:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:48 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 Nov 03 07:47:48 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:48 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:48 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info Nov 03 07:47:48 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info is being set with open permissions: ugo+rw Nov 03 07:47:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:49 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info Nov 03 07:47:49 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:49 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.info" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0dfdae4-0a18-4042-a489-e18b1f3055a1 tempest-TestStampPattern-1143860099 None] Create snapshot completed successfully Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:54 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:47:54 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:54 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=158,cinder:SELECT=122,cinder:INSERT=34,cinder:DELETE=13 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=123,cinder:INSERT=37,cinder:UPDATE=149,cinder:DELETE=12 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Flow 'volume_create_manager' (2f558fc1-10fc-42a5-afcc-9c148eba4696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84de38f9-18cf-4c9c-b3f7-dbae1ae030ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84de38f9-18cf-4c9c-b3f7-dbae1ae030ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1982730410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feced492-02b0-461a-a8f2-a462e4a37686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a501b7ab5c404487911b034e802dbd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6cf15fd4-eecc-449c-8754-ec46409ecb87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:59Z,use_quota=True,user_id='e7509c8ac62c4e6ab4a8d101181d87bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e559ba2-cc75-448f-bbd4-80daa416b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e559ba2-cc75-448f-bbd4-80daa416b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0715f7-6ee0-4a9c-96cf-87be9de6e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0715f7-6ee0-4a9c-96cf-87be9de6e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'feced492-02b0-461a-a8f2-a462e4a37686', 'volume_name': 'volume-feced492-02b0-461a-a8f2-a462e4a37686', 'volume_size': 1, 'snapshot_id': '6cf15fd4-eecc-449c-8754-ec46409ecb87'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d07be0b-b534-4320-94e4-c10af1eb6789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d07be0b-b534-4320-94e4-c10af1eb6789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56253ab-510c-4c0c-81f9-d771952eded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Volume feced492-02b0-461a-a8f2-a462e4a37686: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-feced492-02b0-461a-a8f2-a462e4a37686', 'volume_size': 1, 'snapshot_id': '6cf15fd4-eecc-449c-8754-ec46409ecb87'} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-quobyte-6cf15fd4-eecc-449c-8754-ec46409ecb87-feced492-02b0-461a-a8f2-a462e4a37686" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-6cf15fd4-eecc-449c-8754-ec46409ecb87-feced492-02b0-461a-a8f2-a462e4a37686" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Creating volume feced492-02b0-461a-a8f2-a462e4a37686 from snapshot 6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-quobyte-feced492-02b0-461a-a8f2-a462e4a37686" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-feced492-02b0-461a-a8f2-a462e4a37686" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] snapshot: 6cf15fd4-eecc-449c-8754-ec46409ecb87, volume: feced492-02b0-461a-a8f2-a462e4a37686, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee50732-66d4-4fce-8207-473fa5e39b49]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:58 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 Nov 03 07:47:58 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:59 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8568ea0-9ba6-44a0-8bda-519238174ad5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:59 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a Nov 03 07:47:59 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:59 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:47:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:59 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 Nov 03 07:47:59 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:08 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686" returned: 0 in 9.192s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:08 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:48:08 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Converted 1024.00 MB image at 111.39 MB/s Nov 03 07:48:08 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 is being set with open permissions: ugo+rw Nov 03 07:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:08 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 Nov 03 07:48:08 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:09 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686" returned: 0 in 0.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-feced492-02b0-461a-a8f2-a462e4a37686" released by "_copy_volume_from_snapshot" :: held 10.629s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-6cf15fd4-eecc-449c-8754-ec46409ecb87-feced492-02b0-461a-a8f2-a462e4a37686" released by "_create_volume_from_snapshot" :: held 10.737s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.754s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56253ab-510c-4c0c-81f9-d771952eded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feced492-02b0-461a-a8f2-a462e4a37686', 'volume_size': 1, 'snapshot_id': '6cf15fd4-eecc-449c-8754-ec46409ecb87'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b54ef9-c656-4450-9602-2ce713f688fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Volume volume-feced492-02b0-461a-a8f2-a462e4a37686 (feced492-02b0-461a-a8f2-a462e4a37686): created successfully Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b54ef9-c656-4450-9602-2ce713f688fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Flow 'volume_create_manager' (2f558fc1-10fc-42a5-afcc-9c148eba4696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:48:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8ff9f035-709e-4080-8f18-0740d59ad8cd tempest-TestStampPattern-1143860099 None] Created volume successfully. Nov 03 07:48:19 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:19 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Flow 'volume_create_manager' (9dd85cad-d050-4f65-b559-99ac8e5733dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51b6176-a2b8-4ece-94e5-0fa0783f612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51b6176-a2b8-4ece-94e5-0fa0783f612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1242575006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7121feb7-e4ed-4214-920c-2d6d340b38bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a149fb533d4f28840d3192e8073b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:48:21Z,use_quota=True,user_id='908964f11d63432b8370b03fed77905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0754292-eadf-4f46-8018-1b6805e46d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0754292-eadf-4f46-8018-1b6805e46d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd989e5-e310-4aba-be1b-24c307de43ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd989e5-e310-4aba-be1b-24c307de43ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7121feb7-e4ed-4214-920c-2d6d340b38bc', 'volume_name': 'volume-7121feb7-e4ed-4214-920c-2d6d340b38bc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b329bfb-75bf-4318-8a48-166ccdab1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b329bfb-75bf-4318-8a48-166ccdab1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4893664-660a-4c13-a350-2800e76ed058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Volume 7121feb7-e4ed-4214-920c-2d6d340b38bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7121feb7-e4ed-4214-920c-2d6d340b38bc', 'volume_size': 1} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1242575006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7121feb7-e4ed-4214-920c-2d6d340b38bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a149fb533d4f28840d3192e8073b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:48:21Z,use_quota=True,user_id='908964f11d63432b8370b03fed77905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Creating volume 7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:48:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:21 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc 1073741824 Nov 03 07:48:21 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:21 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc 1073741824" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:21 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc Nov 03 07:48:21 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:21 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc" returned: 0 in 0.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4893664-660a-4c13-a350-2800e76ed058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7121feb7-e4ed-4214-920c-2d6d340b38bc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240a60fc-7234-4d9d-8299-b79aae0a321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Volume volume-7121feb7-e4ed-4214-920c-2d6d340b38bc (7121feb7-e4ed-4214-920c-2d6d340b38bc): created successfully Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240a60fc-7234-4d9d-8299-b79aae0a321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Flow 'volume_create_manager' (9dd85cad-d050-4f65-b559-99ac8e5733dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:48:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8afd0b25-affb-40f9-933b-bb221292ad00 tempest-SnapshotDependencyTests-719467123 None] Created volume successfully. Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Creating offline snapshot 05c2903d-b7d7-4f5c-8086-47a161c9ae5f of volume 7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c23fbc-f10b-4b61-bfba-33ee1c777a07]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:22 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc Nov 03 07:48:22 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:22 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:22 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f 1G Nov 03 07:48:22 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:23 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f 1G" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7121feb7-e4ed-4214-920c-2d6d340b38bc -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:23 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7121feb7-e4ed-4214-920c-2d6d340b38bc -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f Nov 03 07:48:23 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:23 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7121feb7-e4ed-4214-920c-2d6d340b38bc -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f" returned: 0 in 0.315s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:23 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f is being set with open permissions: ugo+rw Nov 03 07:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:23 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f Nov 03 07:48:23 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:23 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:23 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info Nov 03 07:48:23 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:24 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info" returned: 0 in 0.262s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:24 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info is being set with open permissions: ugo+rw Nov 03 07:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:24 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info Nov 03 07:48:24 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:24 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.info" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5cfab1b2-3d0b-4148-8d06-ed0cbe4253aa tempest-SnapshotDependencyTests-719467123 None] Create snapshot completed successfully Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Flow 'volume_create_manager' (5ff38518-6def-43f0-9e18-4ec0f1def1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09de969-613a-4c13-9a3e-7c64d0e4535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09de969-613a-4c13-9a3e-7c64d0e4535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb3de9f-3944-4fa6-a085-501c4332c4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a149fb533d4f28840d3192e8073b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05c2903d-b7d7-4f5c-8086-47a161c9ae5f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:48:25Z,use_quota=True,user_id='908964f11d63432b8370b03fed77905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37ab15b-80dd-4b89-ae1a-465f71076504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37ab15b-80dd-4b89-ae1a-465f71076504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ae3e48-0a2a-4064-8cc4-a30070806751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ae3e48-0a2a-4064-8cc4-a30070806751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cb3de9f-3944-4fa6-a085-501c4332c4a6', 'volume_name': 'volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6', 'volume_size': 1, 'snapshot_id': '05c2903d-b7d7-4f5c-8086-47a161c9ae5f'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9307a489-60f9-43ef-ab4c-3fcb0c248f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9307a489-60f9-43ef-ab4c-3fcb0c248f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68370360-3f81-4667-93bc-077ca44b5992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Volume 3cb3de9f-3944-4fa6-a085-501c4332c4a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6', 'volume_size': 1, 'snapshot_id': '05c2903d-b7d7-4f5c-8086-47a161c9ae5f'} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-quobyte-05c2903d-b7d7-4f5c-8086-47a161c9ae5f-3cb3de9f-3944-4fa6-a085-501c4332c4a6" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-05c2903d-b7d7-4f5c-8086-47a161c9ae5f-3cb3de9f-3944-4fa6-a085-501c4332c4a6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Creating volume 3cb3de9f-3944-4fa6-a085-501c4332c4a6 from snapshot 05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-quobyte-3cb3de9f-3944-4fa6-a085-501c4332c4a6" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-3cb3de9f-3944-4fa6-a085-501c4332c4a6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] snapshot: 05c2903d-b7d7-4f5c-8086-47a161c9ae5f, volume: 3cb3de9f-3944-4fa6-a085-501c4332c4a6, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94dee7d-8543-4a81-b7de-dce77f15916c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:25 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f Nov 03 07:48:25 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:25 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f" returned: 0 in 0.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7121feb7-e4ed-4214-920c-2d6d340b38bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fbdabc-6e4b-4166-b047-1e7cb94262c9]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:25 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc Nov 03 07:48:25 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:25 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:48:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:48:26 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:48:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:26 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 Nov 03 07:48:26 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:31 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6" returned: 0 in 5.781s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:31 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:48:31 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Converted 1024.00 MB image at 177.09 MB/s Nov 03 07:48:31 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 is being set with open permissions: ugo+rw Nov 03 07:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:31 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 Nov 03 07:48:31 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:32 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6" returned: 0 in 0.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-3cb3de9f-3944-4fa6-a085-501c4332c4a6" released by "_copy_volume_from_snapshot" :: held 6.826s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-05c2903d-b7d7-4f5c-8086-47a161c9ae5f-3cb3de9f-3944-4fa6-a085-501c4332c4a6" released by "_create_volume_from_snapshot" :: held 6.892s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.906s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68370360-3f81-4667-93bc-077ca44b5992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6', 'volume_size': 1, 'snapshot_id': '05c2903d-b7d7-4f5c-8086-47a161c9ae5f'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3686813c-ed9e-434e-af4d-968d9ad23b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:48:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Volume volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 (3cb3de9f-3944-4fa6-a085-501c4332c4a6): created successfully Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3686813c-ed9e-434e-af4d-968d9ad23b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Flow 'volume_create_manager' (5ff38518-6def-43f0-9e18-4ec0f1def1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:48:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-79554633-a41b-4994-8273-670bce32ce05 tempest-SnapshotDependencyTests-719467123 None] Created volume successfully. Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-05c2903d-b7d7-4f5c-8086-47a161c9ae5f-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-05c2903d-b7d7-4f5c-8086-47a161c9ae5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-quobyte-7121feb7-e4ed-4214-920c-2d6d340b38bc" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-7121feb7-e4ed-4214-920c-2d6d340b38bc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-quobyte-05c2903d-b7d7-4f5c-8086-47a161c9ae5f" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-05c2903d-b7d7-4f5c-8086-47a161c9ae5f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Deleting offline snapshot 05c2903d-b7d7-4f5c-8086-47a161c9ae5f of volume 7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] snapshot_file for this snap is: volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f017b27-1cbe-481a-94eb-e3f97af6fae6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:32 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f Nov 03 07:48:32 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:33 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f" returned: 0 in 0.354s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7121feb7-e4ed-4214-920c-2d6d340b38bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:48:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3094994-7991-47ed-abb0-60b5f85bd06e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:33 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc Nov 03 07:48:33 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:33 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc" returned: 0 in 0.533s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:33 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f Nov 03 07:48:33 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:34 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:34 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f Nov 03 07:48:34 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:34 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc.05c2903d-b7d7-4f5c-8086-47a161c9ae5f" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-05c2903d-b7d7-4f5c-8086-47a161c9ae5f" released by "_delete_snapshot" :: held 1.642s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-7121feb7-e4ed-4214-920c-2d6d340b38bc" released by "delete_snapshot" :: held 1.665s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Created reservations ['04a4e06b-8257-42df-ac94-bc0e8a4874fe', '2a276751-32c6-45f2-a1be-c44daeb65617', 'ef62af40-9a2b-4a14-9de0-0e0000e2e894', '0e66a8f6-4a05-47a2-81d1-a68030959438'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Delete snapshot completed successfully. Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-38a984e2-a519-476e-ad8d-051aab5c1c97 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-05c2903d-b7d7-4f5c-8086-47a161c9ae5f-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-7121feb7-e4ed-4214-920c-2d6d340b38bc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-7121feb7-e4ed-4214-920c-2d6d340b38bc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-quobyte-7121feb7-e4ed-4214-920c-2d6d340b38bc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-7121feb7-e4ed-4214-920c-2d6d340b38bc" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cf8b9e-6f0e-4912-be17-cea32116ea4a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:35 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc Nov 03 07:48:35 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:35 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:35 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc Nov 03 07:48:35 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:35 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7121feb7-e4ed-4214-920c-2d6d340b38bc" returned: 0 in 0.262s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-7121feb7-e4ed-4214-920c-2d6d340b38bc" released by "delete_volume" :: held 0.715s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Created reservations ['dae0fbcf-19e0-4fa5-9ef9-77ceb3885579', '43def8be-e1e4-46db-89d0-635f4538c515', 'f1fd8f05-8467-4591-abcc-f28204f1bc17', 'ad165a4e-1bf1-4cbd-947e-296fe2a41aed'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:35 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:48:35 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:35 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-3cb3de9f-3944-4fa6-a085-501c4332c4a6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Deleted volume successfully. Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-3cb3de9f-3944-4fa6-a085-501c4332c4a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b95c09b-5181-4fde-a25e-6167a233bbfb tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-7121feb7-e4ed-4214-920c-2d6d340b38bc-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "cinder-quobyte-3cb3de9f-3944-4fa6-a085-501c4332c4a6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-3cb3de9f-3944-4fa6-a085-501c4332c4a6" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3610a9-8d29-425d-acdb-9fc335dbfaab]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:36 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 Nov 03 07:48:36 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:36 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:36 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6 Nov 03 07:48:36 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:36 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3cb3de9f-3944-4fa6-a085-501c4332c4a6" returned: 0 in 0.262s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-quobyte-3cb3de9f-3944-4fa6-a085-501c4332c4a6" released by "delete_volume" :: held 0.685s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Created reservations ['2ce7b1cf-e3a0-4e4c-8acf-9f3b01652e41', 'f95975ac-11a7-453e-bf1d-4d778cbdde62', '494e6224-74fe-4388-80c3-092aa97073c8', '8a64bde8-776c-4516-bd8d-de61d3c70dc8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:36 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:48:36 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:37 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Deleted volume successfully. Nov 03 07:48:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-292cd259-78fd-4c3c-bc64-c38b753a7dd6 tempest-SnapshotDependencyTests-719467123 None] Lock "cinder-3cb3de9f-3944-4fa6-a085-501c4332c4a6-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3c384b87-e364-44fd-9f66-cfbe696c0e74 req-56c288e1-b414-42b3-b037-998415a89427 tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3c384b87-e364-44fd-9f66-cfbe696c0e74 req-56c288e1-b414-42b3-b037-998415a89427 tempest-TestStampPattern-1143860099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3c384b87-e364-44fd-9f66-cfbe696c0e74 req-56c288e1-b414-42b3-b037-998415a89427 tempest-TestStampPattern-1143860099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-3c384b87-e364-44fd-9f66-cfbe696c0e74 req-56c288e1-b414-42b3-b037-998415a89427 tempest-TestStampPattern-1143860099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47', 'name': 'volume-feced492-02b0-461a-a8f2-a462e4a37686', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '518d6a11-5b7f-4aee-9ac4-c3009d916930', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:48:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-3c384b87-e364-44fd-9f66-cfbe696c0e74 req-56c288e1-b414-42b3-b037-998415a89427 tempest-TestStampPattern-1143860099 None] attachment_update completed successfully. Nov 03 07:48:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8ca9d857-d089-473c-9f12-c0b2dbf7ed24 req-f3950f67-23a3-4acb-b5ae-4039b215061b tempest-TestStampPattern-1143860099 None] Terminate volume connection completed successfully. Nov 03 07:48:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8ca9d857-d089-473c-9f12-c0b2dbf7ed24 req-f3950f67-23a3-4acb-b5ae-4039b215061b tempest-TestStampPattern-1143860099 None] Deleting attachment 518d6a11-5b7f-4aee-9ac4-c3009d916930. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-feced492-02b0-461a-a8f2-a462e4a37686-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Lock "cinder-feced492-02b0-461a-a8f2-a462e4a37686-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-quobyte-feced492-02b0-461a-a8f2-a462e4a37686" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-feced492-02b0-461a-a8f2-a462e4a37686" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2573322b-47be-42a3-a818-e623abfbff0e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:46 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 Nov 03 07:48:46 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:46 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:46 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686 Nov 03 07:48:46 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:47 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-feced492-02b0-461a-a8f2-a462e4a37686" returned: 0 in 0.253s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-feced492-02b0-461a-a8f2-a462e4a37686" released by "delete_volume" :: held 0.692s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Created reservations ['90132b9a-21bf-4560-bfb8-839326420953', 'f9c0c02b-2885-4209-98c9-c71f74b64174', '92daa22d-b7a2-4289-a37a-8d69281bd556', '687ad03b-fb40-49aa-a4de-b910c09f1b34'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:47 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:48:47 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:47 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Deleted volume successfully. Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d64882d7-dba0-43c8-b338-a85f2cb266cc tempest-TestStampPattern-1143860099 None] Lock "cinder-feced492-02b0-461a-a8f2-a462e4a37686-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-6cf15fd4-eecc-449c-8754-ec46409ecb87-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Lock "cinder-6cf15fd4-eecc-449c-8754-ec46409ecb87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-quobyte-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-quobyte-6cf15fd4-eecc-449c-8754-ec46409ecb87" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-6cf15fd4-eecc-449c-8754-ec46409ecb87" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Deleting offline snapshot 6cf15fd4-eecc-449c-8754-ec46409ecb87 of volume e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] snapshot_file for this snap is: volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af73a7d-a1cd-4afd-b518-5a762ee5c319]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:48 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 Nov 03 07:48:48 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:48 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:48:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[283e4f2d-580c-414f-a6ac-727843804bcd]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:48 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a Nov 03 07:48:48 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:48 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" returned: 0 in 0.561s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:48 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 Nov 03 07:48:48 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:49 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:49 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87 Nov 03 07:48:49 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:49 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a.6cf15fd4-eecc-449c-8754-ec46409ecb87" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-6cf15fd4-eecc-449c-8754-ec46409ecb87" released by "_delete_snapshot" :: held 1.720s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" released by "delete_snapshot" :: held 1.747s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Created reservations ['9bcca4bd-808d-4680-abdf-1bce646cea73', '6808af10-c121-4947-a340-f3df571311f9', 'bf557fb8-2785-4f79-a2ae-1081c5a7b7c8', '941034f3-6089-4345-83d0-35178cfaa178'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Delete snapshot completed successfully. Nov 03 07:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0b1653f-7826-4deb-92de-05a0d63a24c7 tempest-TestStampPattern-1143860099 None] Lock "cinder-6cf15fd4-eecc-449c-8754-ec46409ecb87-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-e7b7fa22-08c4-45b3-a3a0-f78c6260529a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Lock "cinder-e7b7fa22-08c4-45b3-a3a0-f78c6260529a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Acquiring lock "cinder-quobyte-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[959bbb68-c075-40be-afa4-95fc1cc227da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:53 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a Nov 03 07:48:53 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:53 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:53 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a Nov 03 07:48:53 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:54 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Lock "cinder-quobyte-e7b7fa22-08c4-45b3-a3a0-f78c6260529a" released by "delete_volume" :: held 0.657s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Created reservations ['9e9eeeff-903a-4cb4-83cf-98552f5c2172', '06bcc87c-18dc-44f4-bcfa-af2e9431d62b', '43bbff40-477f-4e10-95b8-cf818b836e6c', 'f30450cb-f408-4411-acd6-bc8fdbff35e0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:54 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:48:54 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:54 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:48:54 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:54 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Deleted volume successfully. Nov 03 07:48:54 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31d1ce0d-6785-49d4-823c-e5a706154e19 tempest-TestStampPattern-1143860099 None] Lock "cinder-e7b7fa22-08c4-45b3-a3a0-f78c6260529a-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:48:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:49:04 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=47,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=14 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:49:04 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=49,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Flow 'volume_create_manager' (41b2d2fd-8271-4af3-be4f-5ac6d5f9fea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1526c7-ea6a-4e1d-9276-e222de7853c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1526c7-ea6a-4e1d-9276-e222de7853c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc535cfd-ebe5-4977-b14b-9f34ffec1b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880fddebcd334b06a2ab0c68ff97f95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:10Z,use_quota=True,user_id='67f068c2dfea471bbbde1319d5876620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a9ca31c-abf2-4c22-a880-44f10b600c31),volume_type_id=6a9ca31c-abf2-4c22-a880-44f10b600c31)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a09e43-fdf8-4d80-b6c8-02573a0506b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a09e43-fdf8-4d80-b6c8-02573a0506b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1306d1-035c-459c-9f07-bdd84673ca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:09 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1306d1-035c-459c-9f07-bdd84673ca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc535cfd-ebe5-4977-b14b-9f34ffec1b19', 'volume_name': 'volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19', 'volume_size': 1, 'image_id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a91581c3-815d-4617-9dfa-2398898ac8bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e95006ac9529ddc01dfe1e156a1ad6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '880fddebcd334b06a2ab0c68ff97f95c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8876313347b9b9ef373d4d9c72a5ee8714f0516cc409f5ba3ff1946e2c4fa89ee75e93121137dc938692e8a3afe7478b0ee01c3572bddc4d0edabcc19be1fdb2', 'id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a91581c3-815d-4617-9dfa-2398898ac8bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc99c70c-68c7-429e-9ba1-a9dd8aea86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc99c70c-68c7-429e-9ba1-a9dd8aea86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24047aa7-c09b-4986-9717-303d52576f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Volume cc535cfd-ebe5-4977-b14b-9f34ffec1b19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19', 'volume_size': 1, 'image_id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a91581c3-815d-4617-9dfa-2398898ac8bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e95006ac9529ddc01dfe1e156a1ad6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '880fddebcd334b06a2ab0c68ff97f95c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8876313347b9b9ef373d4d9c72a5ee8714f0516cc409f5ba3ff1946e2c4fa89ee75e93121137dc938692e8a3afe7478b0ee01c3572bddc4d0edabcc19be1fdb2', 'id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a91581c3-815d-4617-9dfa-2398898ac8bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Trying to clone cc535cfd-ebe5-4977-b14b-9f34ffec1b19 from image a91581c3-815d-4617-9dfa-2398898ac8bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a91581c3-815d-4617-9dfa-2398898ac8bc', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:49:10 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c7c5f-1089-41b7-84e1-52dfcc457d76]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:10 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD Nov 03 07:49:10 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:10 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:10 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD Nov 03 07:49:10 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:10 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:10 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Temporary image a91581c3-815d-4617-9dfa-2398898ac8bc is fetched for user 67f068c2dfea471bbbde1319d5876620. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[56390efd-94c6-4175-af2c-26ccc63946f6]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:11 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD Nov 03 07:49:11 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:11 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:11 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD Nov 03 07:49:11 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:11 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc535cfd-ebe5-4977-b14b-9f34ffec1b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880fddebcd334b06a2ab0c68ff97f95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:10Z,use_quota=True,user_id='67f068c2dfea471bbbde1319d5876620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a9ca31c-abf2-4c22-a880-44f10b600c31),volume_type_id=6a9ca31c-abf2-4c22-a880-44f10b600c31)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Creating volume cc535cfd-ebe5-4977-b14b-9f34ffec1b19 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:11 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 1073741824 Nov 03 07:49:11 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:12 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 1073741824" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:12 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 Nov 03 07:49:12 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:12 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Attempting download of a91581c3-815d-4617-9dfa-2398898ac8bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a91581c3-815d-4617-9dfa-2398898ac8bc', 'metadata': {}}])) to volume cc535cfd-ebe5-4977-b14b-9f34ffec1b19. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8b2c34-31b4-4dea-972f-f0b99183b985]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:12 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg Nov 03 07:49:12 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:12 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:12 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg Nov 03 07:49:12 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:13 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg" returned: 1 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a91581c3-815d-4617-9dfa-2398898ac8bc_g8_1b4jg' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[389bcf7f-0781-4d0c-8a61-75d63ced5339]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:13 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD Nov 03 07:49:13 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:13 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:13 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD Nov 03 07:49:13 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:13 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD" returned: 1 in 0.308s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] a91581c3-815d-4617-9dfa-2398898ac8bc was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:13 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 Nov 03 07:49:13 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:14 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a91581c3-815d-4617-9dfa-2398898ac8bc_obfril1rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:49:14 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:14 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 1G Nov 03 07:49:14 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:14 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 1G" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Downloaded image a91581c3-815d-4617-9dfa-2398898ac8bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a91581c3-815d-4617-9dfa-2398898ac8bc', 'metadata': {}}])) to volume cc535cfd-ebe5-4977-b14b-9f34ffec1b19 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Temporary image a91581c3-815d-4617-9dfa-2398898ac8bc for user 67f068c2dfea471bbbde1319d5876620 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Marking volume cc535cfd-ebe5-4977-b14b-9f34ffec1b19 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Copying metadata from image a91581c3-815d-4617-9dfa-2398898ac8bc to cc535cfd-ebe5-4977-b14b-9f34ffec1b19. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Creating volume glance metadata for volume cc535cfd-ebe5-4977-b14b-9f34ffec1b19 backed by image a91581c3-815d-4617-9dfa-2398898ac8bc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f1e95006ac9529ddc01dfe1e156a1ad6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24047aa7-c09b-4986-9717-303d52576f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19', 'volume_size': 1, 'image_id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a91581c3-815d-4617-9dfa-2398898ac8bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e95006ac9529ddc01dfe1e156a1ad6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '880fddebcd334b06a2ab0c68ff97f95c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8876313347b9b9ef373d4d9c72a5ee8714f0516cc409f5ba3ff1946e2c4fa89ee75e93121137dc938692e8a3afe7478b0ee01c3572bddc4d0edabcc19be1fdb2', 'id': 'a91581c3-815d-4617-9dfa-2398898ac8bc', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a91581c3-815d-4617-9dfa-2398898ac8bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc89bc1-0c26-4226-bf59-216d90ea1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Volume volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 (cc535cfd-ebe5-4977-b14b-9f34ffec1b19): created successfully Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc89bc1-0c26-4226-bf59-216d90ea1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Flow 'volume_create_manager' (41b2d2fd-8271-4af3-be4f-5ac6d5f9fea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2336fd99-e77d-4993-b502-1bc501d24521 tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Created volume successfully. Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Acquiring lock "cinder-cc535cfd-ebe5-4977-b14b-9f34ffec1b19-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "cinder-cc535cfd-ebe5-4977-b14b-9f34ffec1b19-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Acquiring lock "cinder-quobyte-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "cinder-quobyte-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb9ed41-74b1-4628-94ac-622550e0edf9]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:15 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 Nov 03 07:49:15 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:15 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" returned: 0 in 0.345s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:15 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19 Nov 03 07:49:15 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:15 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "cinder-quobyte-cc535cfd-ebe5-4977-b14b-9f34ffec1b19" released by "delete_volume" :: held 0.638s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:15 devstack cinder-volume[86916]: WARNING cinder.quota [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:49:15 devstack cinder-volume[86916]: WARNING cinder.quota [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Created reservations ['c0260ef3-cdd5-4ae6-9e2f-234551dbc0cf', 'b9dbc444-029b-439b-bd12-7d900d9c2a6f', '527de8f8-8d2e-4cf8-9636-ac0e56fc2c81', 'e49249d0-96df-4dce-9fed-37107b507a7f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:15 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:15 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:16 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.229s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Deleted volume successfully. Nov 03 07:49:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00350dc6-7cd7-4972-8020-eaae3d39312f tempest-VolumeAndVolumeTypeFromImageTest-333459747 None] Lock "cinder-cc535cfd-ebe5-4977-b14b-9f34ffec1b19-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (c4deb170-aea1-4e7f-ad5d-df3f4dd43ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6451b00b-0557-47d7-bf38-33deb0ddd3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6451b00b-0557-47d7-bf38-33deb0ddd3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1842480719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cefe10f-51db-47a1-9912-0c0f0d9e42b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:20Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455d22d4-2930-42be-82ac-9c7195a8978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455d22d4-2930-42be-82ac-9c7195a8978c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0150f4aa-a9c7-4086-bbee-08043118adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0150f4aa-a9c7-4086-bbee-08043118adc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cefe10f-51db-47a1-9912-0c0f0d9e42b7', 'volume_name': 'volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e237dd-9ebc-44c8-9b73-84ad065296e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e237dd-9ebc-44c8-9b73-84ad065296e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5445258-dc5a-4161-97e2-8746ef71fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Volume 7cefe10f-51db-47a1-9912-0c0f0d9e42b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7', 'volume_size': 1} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1842480719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cefe10f-51db-47a1-9912-0c0f0d9e42b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:20Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Creating volume 7cefe10f-51db-47a1-9912-0c0f0d9e42b7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:20 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:20 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 1073741824 Nov 03 07:49:20 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (aa22b39d-8479-4e6b-9ef6-670dc23a16a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639d3e4b-86da-4b94-8941-dbdbf3d4fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639d3e4b-86da-4b94-8941-dbdbf3d4fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409628822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d722e47-648a-4441-a563-12c913bacbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:21Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffe2964-c5c3-4610-93be-f000ed9c7ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffe2964-c5c3-4610-93be-f000ed9c7ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae3d9b9-8d4a-41f5-bb5d-7bdabc393bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae3d9b9-8d4a-41f5-bb5d-7bdabc393bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d722e47-648a-4441-a563-12c913bacbca', 'volume_name': 'volume-2d722e47-648a-4441-a563-12c913bacbca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe85cbbe-db43-489b-b22c-c1c1fcca0fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe85cbbe-db43-489b-b22c-c1c1fcca0fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea9a1e7-5b78-4519-8e75-3ab5e69e7051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Volume 2d722e47-648a-4441-a563-12c913bacbca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d722e47-648a-4441-a563-12c913bacbca', 'volume_size': 1} Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:20 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 1073741824" returned: 0 in 0.522s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:21 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 Nov 03 07:49:21 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (5a1bb04f-bb66-415b-9346-4a0fdbaaee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1504bc-f3fb-416a-a9b5-feba11261178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1504bc-f3fb-416a-a9b5-feba11261178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277051490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936c53d9-580c-40ab-b4fa-48ef8c48c291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:21Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8ae5bd-826a-402e-8e71-aa5f80c8b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8ae5bd-826a-402e-8e71-aa5f80c8b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33b66-0134-4284-9dbd-01d34f058d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33b66-0134-4284-9dbd-01d34f058d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936c53d9-580c-40ab-b4fa-48ef8c48c291', 'volume_name': 'volume-936c53d9-580c-40ab-b4fa-48ef8c48c291', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dcd5cd-a12c-46e5-96a6-5e019fc93e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dcd5cd-a12c-46e5-96a6-5e019fc93e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee7a25f-e801-4dcc-9e76-432578796e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Volume 936c53d9-580c-40ab-b4fa-48ef8c48c291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936c53d9-580c-40ab-b4fa-48ef8c48c291', 'volume_size': 1} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:21 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-409628822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d722e47-648a-4441-a563-12c913bacbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:21Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Creating volume 2d722e47-648a-4441-a563-12c913bacbca {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5445258-dc5a-4161-97e2-8746ef71fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca 1073741824 Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746cec44-fffd-479b-a76d-aa9e1b626905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Volume volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 (7cefe10f-51db-47a1-9912-0c0f0d9e42b7): created successfully Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746cec44-fffd-479b-a76d-aa9e1b626905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (c4deb170-aea1-4e7f-ad5d-df3f4dd43ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-797a3908-5b11-4d55-9361-db0bc25c92da tempest-CreateVolumesFromImageTest-1520185526 None] Created volume successfully. Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (9e7144dc-59ae-4df9-9a84-d5cc542dd469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5f116a-06e3-4a7a-b276-6728dec0af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5f116a-06e3-4a7a-b276-6728dec0af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-880254855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53590905-c0f2-4b55-90a4-a90c9c80e1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:21Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b4df8e-df46-49f9-a8a6-92f03eac588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b4df8e-df46-49f9-a8a6-92f03eac588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ec815f-1a2c-4075-87f5-463ddd38f756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ec815f-1a2c-4075-87f5-463ddd38f756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53590905-c0f2-4b55-90a4-a90c9c80e1e1', 'volume_name': 'volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4937ab-1365-4c23-ae4f-40c1728e4566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4937ab-1365-4c23-ae4f-40c1728e4566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c3acd-5caf-472a-8cca-a796765931ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Volume 53590905-c0f2-4b55-90a4-a90c9c80e1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1', 'volume_size': 1} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:21 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca 1073741824" returned: 0 in 0.533s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (8eab0864-a564-47eb-9098-98e36d1452b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98f7b83-305d-47dd-8513-51d972ca3fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98f7b83-305d-47dd-8513-51d972ca3fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105082139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abda0b50-50d9-44d0-b088-57ee09558b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:22Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f77c94-5d9b-435d-9697-6834af2973eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f77c94-5d9b-435d-9697-6834af2973eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb43eea8-7594-4512-aee2-5e7fa8711310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb43eea8-7594-4512-aee2-5e7fa8711310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abda0b50-50d9-44d0-b088-57ee09558b9e', 'volume_name': 'volume-abda0b50-50d9-44d0-b088-57ee09558b9e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862560a-6b53-4f8b-8bb9-2baf203251e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862560a-6b53-4f8b-8bb9-2baf203251e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41900e4-4b31-4b1d-b8ac-da221cb3e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Volume abda0b50-50d9-44d0-b088-57ee09558b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abda0b50-50d9-44d0-b088-57ee09558b9e', 'volume_size': 1} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:21 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca Nov 03 07:49:21 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:22 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca" returned: 0 in 0.232s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277051490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936c53d9-580c-40ab-b4fa-48ef8c48c291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:21Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Creating volume 936c53d9-580c-40ab-b4fa-48ef8c48c291 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:22 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea9a1e7-5b78-4519-8e75-3ab5e69e7051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d722e47-648a-4441-a563-12c913bacbca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192d08c2-858a-4d1c-8291-e89b83cbf0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:22 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 1073741824 Nov 03 07:49:22 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Volume volume-2d722e47-648a-4441-a563-12c913bacbca (2d722e47-648a-4441-a563-12c913bacbca): created successfully Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192d08c2-858a-4d1c-8291-e89b83cbf0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (aa22b39d-8479-4e6b-9ef6-670dc23a16a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-14f7d944-aa3f-41ef-a019-2bd234fe2d9b tempest-CreateVolumesFromImageTest-1520185526 None] Created volume successfully. Nov 03 07:49:22 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 1073741824" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:22 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 Nov 03 07:49:22 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:22 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-880254855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53590905-c0f2-4b55-90a4-a90c9c80e1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:21Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Creating volume 53590905-c0f2-4b55-90a4-a90c9c80e1e1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:22 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee7a25f-e801-4dcc-9e76-432578796e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936c53d9-580c-40ab-b4fa-48ef8c48c291', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:22 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 1073741824 Nov 03 07:49:22 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c14b108-fe0f-4c31-bc83-36f84f7b77fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Volume volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 (936c53d9-580c-40ab-b4fa-48ef8c48c291): created successfully Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c14b108-fe0f-4c31-bc83-36f84f7b77fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (5a1bb04f-bb66-415b-9346-4a0fdbaaee66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-10695f2d-01b2-4c5f-b880-12f5dc2f5a08 tempest-CreateVolumesFromImageTest-1520185526 None] Created volume successfully. Nov 03 07:49:23 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 1073741824" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:23 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 Nov 03 07:49:23 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:23 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1" returned: 0 in 0.237s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105082139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abda0b50-50d9-44d0-b088-57ee09558b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c35285331a44d0baae3be40677a0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:22Z,use_quota=True,user_id='c5393c001f664a74902426a5f039499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Creating volume abda0b50-50d9-44d0-b088-57ee09558b9e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:23 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e 1073741824 Nov 03 07:49:23 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c3acd-5caf-472a-8cca-a796765931ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02ae6e3-56c3-4302-a9ad-2c4cf549285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Volume volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 (53590905-c0f2-4b55-90a4-a90c9c80e1e1): created successfully Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02ae6e3-56c3-4302-a9ad-2c4cf549285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (9e7144dc-59ae-4df9-9a84-d5cc542dd469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5401de20-3aa1-4876-9232-3af2bd520853 tempest-CreateVolumesFromImageTest-1520185526 None] Created volume successfully. Nov 03 07:49:24 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e 1073741824" returned: 0 in 0.431s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:24 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e Nov 03 07:49:24 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:24 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e" returned: 0 in 0.241s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41900e4-4b31-4b1d-b8ac-da221cb3e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abda0b50-50d9-44d0-b088-57ee09558b9e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bcdbf8-1ede-4939-b266-87a21a982162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Volume volume-abda0b50-50d9-44d0-b088-57ee09558b9e (abda0b50-50d9-44d0-b088-57ee09558b9e): created successfully Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bcdbf8-1ede-4939-b266-87a21a982162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Flow 'volume_create_manager' (8eab0864-a564-47eb-9098-98e36d1452b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c97a90e9-d4bf-422a-aae3-3b22e4b4200f tempest-CreateVolumesFromImageTest-1520185526 None] Created volume successfully. Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-abda0b50-50d9-44d0-b088-57ee09558b9e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-abda0b50-50d9-44d0-b088-57ee09558b9e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-quobyte-abda0b50-50d9-44d0-b088-57ee09558b9e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-abda0b50-50d9-44d0-b088-57ee09558b9e" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01e9f1-2ded-4dff-9fc1-f634c050fe02]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:25 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e Nov 03 07:49:25 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:25 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e" returned: 0 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:25 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e Nov 03 07:49:25 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:25 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-abda0b50-50d9-44d0-b088-57ee09558b9e" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-abda0b50-50d9-44d0-b088-57ee09558b9e" released by "delete_volume" :: held 0.669s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Created reservations ['de6718e4-1c3d-4211-99d9-3d341ad33742', 'f0223513-2ee4-4109-a414-430b0cf88b86', '611ea67e-93ed-40f1-9905-1a746bb7a095', '368b8388-9ecd-45b9-a07b-1c3c0c9e5862'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:26 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:26 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:26 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Deleted volume successfully. Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-53590905-c0f2-4b55-90a4-a90c9c80e1e1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3cc6d19-5978-4049-ac20-70ed3dab04a0 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-abda0b50-50d9-44d0-b088-57ee09558b9e-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-53590905-c0f2-4b55-90a4-a90c9c80e1e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-quobyte-53590905-c0f2-4b55-90a4-a90c9c80e1e1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-53590905-c0f2-4b55-90a4-a90c9c80e1e1" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c467d-29c6-4f3a-824c-cf49f8fa99c5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:26 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 Nov 03 07:49:26 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:26 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:26 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1 Nov 03 07:49:26 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:27 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-53590905-c0f2-4b55-90a4-a90c9c80e1e1" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-53590905-c0f2-4b55-90a4-a90c9c80e1e1" released by "delete_volume" :: held 0.653s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Created reservations ['f1c1023f-5e05-42ab-8ba8-1cb7780bdcc3', 'c94269f6-b8d6-4ce4-979d-98b94b53ea6a', '6b113dba-146b-4e75-aaf7-d76e8494b425', 'e71f4dab-aab5-486c-a239-9dfa45d41875'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:27 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:27 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:27 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Deleted volume successfully. Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c41deb23-8c69-4810-87b1-a9b8752c71fa tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-53590905-c0f2-4b55-90a4-a90c9c80e1e1-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-936c53d9-580c-40ab-b4fa-48ef8c48c291-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-936c53d9-580c-40ab-b4fa-48ef8c48c291-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-quobyte-936c53d9-580c-40ab-b4fa-48ef8c48c291" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-936c53d9-580c-40ab-b4fa-48ef8c48c291" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6e5d7-5fe6-4e7e-9641-2ddd3ace4c36]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:27 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 Nov 03 07:49:27 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:27 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:28 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291 Nov 03 07:49:28 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:28 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-936c53d9-580c-40ab-b4fa-48ef8c48c291" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-936c53d9-580c-40ab-b4fa-48ef8c48c291" released by "delete_volume" :: held 0.624s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Created reservations ['f3094e88-46b9-4636-abb6-7b6d6d8cc07c', 'b14855c8-086c-451f-8c1e-c88a9fdd239e', '199764a1-a0ed-4ea4-bd6d-c67f1ca5856a', 'e6ab45bf-e8cd-430b-b63d-0c3238e3aef0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:28 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:28 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:28 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Deleted volume successfully. Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d046e281-2791-400a-a0e5-f54afd9f7931 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-936c53d9-580c-40ab-b4fa-48ef8c48c291-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-2d722e47-648a-4441-a563-12c913bacbca-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-2d722e47-648a-4441-a563-12c913bacbca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-quobyte-2d722e47-648a-4441-a563-12c913bacbca" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-2d722e47-648a-4441-a563-12c913bacbca" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39bb315-a9a7-447b-9399-46f289c9d169]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:28 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca Nov 03 07:49:28 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:29 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:29 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca Nov 03 07:49:29 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:29 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2d722e47-648a-4441-a563-12c913bacbca" returned: 0 in 0.232s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-2d722e47-648a-4441-a563-12c913bacbca" released by "delete_volume" :: held 0.609s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Created reservations ['9a886855-3f02-4bbb-863b-b16c930d0b33', 'df3ea352-df25-4b39-b60e-96506e921994', '321e685e-2f5b-485a-abf0-3b045b78a363', 'c31daac7-ae5c-4d99-bdf9-3c9ce5205c3f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:29 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:29 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:29 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.246s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Deleted volume successfully. Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1eeaf799-3e33-419b-9837-8f1ad4ddd148 tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-2d722e47-648a-4441-a563-12c913bacbca-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-7cefe10f-51db-47a1-9912-0c0f0d9e42b7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-7cefe10f-51db-47a1-9912-0c0f0d9e42b7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "cinder-quobyte-7cefe10f-51db-47a1-9912-0c0f0d9e42b7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-7cefe10f-51db-47a1-9912-0c0f0d9e42b7" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4565ef-65a6-4e93-83b3-e434ae886eb7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:30 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 Nov 03 07:49:30 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:30 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:30 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7 Nov 03 07:49:30 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:30 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7cefe10f-51db-47a1-9912-0c0f0d9e42b7" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-quobyte-7cefe10f-51db-47a1-9912-0c0f0d9e42b7" released by "delete_volume" :: held 0.638s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Created reservations ['4b8ca1cd-a0ab-44b2-88b8-fe8d96376024', 'c7d8ce5a-c4f6-41a6-8770-0ac7a220498e', 'cd6eda50-3d8c-4171-8c57-a66697001670', '07a6d371-8a38-45d5-96ec-2915ec6fb70d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:30 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:30 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:30 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.234s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Deleted volume successfully. Nov 03 07:49:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e0b24855-5922-4479-9f69-47c393c077df tempest-CreateVolumesFromImageTest-1520185526 None] Lock "cinder-7cefe10f-51db-47a1-9912-0c0f0d9e42b7-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Flow 'volume_create_manager' (5c5ac672-d630-4445-90e2-d1991c6b74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306d4a39-94f4-4d87-a355-c182bd88e83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306d4a39-94f4-4d87-a355-c182bd88e83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1672674408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbee369-5bc0-4125-b86b-456729b07fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ffc19d749485f951008a9c6960628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:34Z,use_quota=True,user_id='cad0e78185804dfd8717275172feb06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd4c8f3-e958-48c2-ad42-8f973557e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd4c8f3-e958-48c2-ad42-8f973557e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493080d0-c5d2-4126-8ca3-7fc67d453c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493080d0-c5d2-4126-8ca3-7fc67d453c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbee369-5bc0-4125-b86b-456729b07fe7', 'volume_name': 'volume-ebbee369-5bc0-4125-b86b-456729b07fe7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb46fce-0bfe-4760-81d8-36ef430387d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb46fce-0bfe-4760-81d8-36ef430387d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7497eefe-2164-4774-bf90-a09056d67254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Volume ebbee369-5bc0-4125-b86b-456729b07fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbee369-5bc0-4125-b86b-456729b07fe7', 'volume_size': 1} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1672674408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbee369-5bc0-4125-b86b-456729b07fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ffc19d749485f951008a9c6960628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:34Z,use_quota=True,user_id='cad0e78185804dfd8717275172feb06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Creating volume ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:34 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 1073741824 Nov 03 07:49:34 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:34 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 1073741824" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:34 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 Nov 03 07:49:34 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:34 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7" returned: 0 in 0.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7497eefe-2164-4774-bf90-a09056d67254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbee369-5bc0-4125-b86b-456729b07fe7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec100d40-e87b-4092-9238-9134bf53b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Volume volume-ebbee369-5bc0-4125-b86b-456729b07fe7 (ebbee369-5bc0-4125-b86b-456729b07fe7): created successfully Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec100d40-e87b-4092-9238-9134bf53b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Flow 'volume_create_manager' (5c5ac672-d630-4445-90e2-d1991c6b74af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-477cc42b-1399-4fcb-ab12-c509507a688a tempest-VolumeDependencyTests-2025072446 None] Created volume successfully. Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Creating offline snapshot f707f565-6c23-483f-a8c0-5ca35cd16937 of volume ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c5858-e5e9-454f-8e8a-0c1dd02cc12f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:35 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 Nov 03 07:49:35 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:35 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:35 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 1G Nov 03 07:49:35 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:35 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 1G" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbee369-5bc0-4125-b86b-456729b07fe7 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:35 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbee369-5bc0-4125-b86b-456729b07fe7 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 Nov 03 07:49:35 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:36 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbee369-5bc0-4125-b86b-456729b07fe7 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 is being set with open permissions: ugo+rw Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:36 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 Nov 03 07:49:36 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:36 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937" returned: 0 in 0.237s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:36 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info Nov 03 07:49:36 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:36 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info is being set with open permissions: ugo+rw Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:36 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info Nov 03 07:49:36 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:36 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.info" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5ed5f95f-5357-40eb-854f-cedb2b3d9d99 tempest-VolumeDependencyTests-2025072446 None] Create snapshot completed successfully Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Flow 'volume_create_manager' (a07c44e3-4281-4a0c-ae1f-83d0f0d9a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab6436a-573b-4c90-9497-8d9c1a508be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab6436a-573b-4c90-9497-8d9c1a508be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-539306554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00eb3e93-3f02-48d3-a385-fbfcb6f1661d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ffc19d749485f951008a9c6960628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f707f565-6c23-483f-a8c0-5ca35cd16937,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:38Z,use_quota=True,user_id='cad0e78185804dfd8717275172feb06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf4e069-3fa2-4319-b5e8-8c172bd8c132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf4e069-3fa2-4319-b5e8-8c172bd8c132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0884281-d0d4-4e58-93d3-2b5c4996bdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0884281-d0d4-4e58-93d3-2b5c4996bdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00eb3e93-3f02-48d3-a385-fbfcb6f1661d', 'volume_name': 'volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d', 'volume_size': 1, 'snapshot_id': 'f707f565-6c23-483f-a8c0-5ca35cd16937'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a59cfe-d7f6-403b-9014-504ce46b0857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a59cfe-d7f6-403b-9014-504ce46b0857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd14f9d-a9cc-4274-9af3-df2a2a2d80dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Volume 00eb3e93-3f02-48d3-a385-fbfcb6f1661d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d', 'volume_size': 1, 'snapshot_id': 'f707f565-6c23-483f-a8c0-5ca35cd16937'} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-quobyte-f707f565-6c23-483f-a8c0-5ca35cd16937-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-f707f565-6c23-483f-a8c0-5ca35cd16937-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Creating volume 00eb3e93-3f02-48d3-a385-fbfcb6f1661d from snapshot f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-quobyte-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] snapshot: f707f565-6c23-483f-a8c0-5ca35cd16937, volume: 00eb3e93-3f02-48d3-a385-fbfcb6f1661d, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d784df7-e4e5-425e-a7d5-1b16bdc8204f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:37 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 Nov 03 07:49:37 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:38 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebbee369-5bc0-4125-b86b-456729b07fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae13468f-fa1b-44c2-89db-92b801f23740]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:38 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 Nov 03 07:49:38 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:38 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:38 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d Nov 03 07:49:38 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:44 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" returned: 0 in 5.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:49:44 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Converted 1024.00 MB image at 178.33 MB/s Nov 03 07:49:44 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d is being set with open permissions: ugo+rw Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:44 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d Nov 03 07:49:44 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:44 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" returned: 0 in 0.227s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" released by "_copy_volume_from_snapshot" :: held 6.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-f707f565-6c23-483f-a8c0-5ca35cd16937-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" released by "_create_volume_from_snapshot" :: held 6.798s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.812s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd14f9d-a9cc-4274-9af3-df2a2a2d80dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d', 'volume_size': 1, 'snapshot_id': 'f707f565-6c23-483f-a8c0-5ca35cd16937'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a072d5-c6e6-4737-884a-7936a6096589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Volume volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d (00eb3e93-3f02-48d3-a385-fbfcb6f1661d): created successfully Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a072d5-c6e6-4737-884a-7936a6096589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Flow 'volume_create_manager' (a07c44e3-4281-4a0c-ae1f-83d0f0d9a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c33485c1-78ac-49e2-a8be-18117fb08618 tempest-VolumeDependencyTests-2025072446 None] Created volume successfully. Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-f707f565-6c23-483f-a8c0-5ca35cd16937-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-f707f565-6c23-483f-a8c0-5ca35cd16937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-quobyte-ebbee369-5bc0-4125-b86b-456729b07fe7" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-ebbee369-5bc0-4125-b86b-456729b07fe7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-quobyte-f707f565-6c23-483f-a8c0-5ca35cd16937" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-f707f565-6c23-483f-a8c0-5ca35cd16937" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Deleting offline snapshot f707f565-6c23-483f-a8c0-5ca35cd16937 of volume ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] snapshot_file for this snap is: volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b070320-332f-4c70-a45e-45256fb50c3d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:45 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 Nov 03 07:49:45 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:45 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebbee369-5bc0-4125-b86b-456729b07fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[19761b1f-47ad-43c4-8467-be0c06efe27e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:45 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 Nov 03 07:49:45 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:46 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7" returned: 0 in 0.499s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:46 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 Nov 03 07:49:46 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:46 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:46 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937 Nov 03 07:49:46 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:46 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7.f707f565-6c23-483f-a8c0-5ca35cd16937" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-f707f565-6c23-483f-a8c0-5ca35cd16937" released by "_delete_snapshot" :: held 1.535s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-ebbee369-5bc0-4125-b86b-456729b07fe7" released by "delete_snapshot" :: held 1.558s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Created reservations ['c4823e7c-f324-4a9b-aae5-111eac14832b', '714854e8-fe82-4f24-a3f7-aa28b9832c44', '32c49989-5c4e-4636-a435-70eb3f6f84f5', 'edc58c26-726e-42d4-8d7f-3260436c79fe'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Delete snapshot completed successfully. Nov 03 07:49:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07a8fea3-cb97-4a3e-ad97-e429eb9b8af4 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-f707f565-6c23-483f-a8c0-5ca35cd16937-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-ebbee369-5bc0-4125-b86b-456729b07fe7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-ebbee369-5bc0-4125-b86b-456729b07fe7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-quobyte-ebbee369-5bc0-4125-b86b-456729b07fe7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-ebbee369-5bc0-4125-b86b-456729b07fe7" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8068552e-2663-44fe-8873-f7f6fbe71ee8]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:47 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 Nov 03 07:49:47 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:47 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:47 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7 Nov 03 07:49:47 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:48 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ebbee369-5bc0-4125-b86b-456729b07fe7" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-ebbee369-5bc0-4125-b86b-456729b07fe7" released by "delete_volume" :: held 0.691s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Created reservations ['4f5b737f-2e8d-4c8e-b1f2-e0a35dc8841b', 'e49a5b27-8745-4eb5-9dc7-29e0098ab86d', 'e0805f2c-215a-4109-8556-efc2da2ce26b', 'e215c01d-705c-4899-b8cd-de0ad2efb149'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:48 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:48 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:48 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Deleted volume successfully. Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5d3457d4-ab7c-45ca-9827-78b60f8384ae tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-ebbee369-5bc0-4125-b86b-456729b07fe7-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-00eb3e93-3f02-48d3-a385-fbfcb6f1661d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-00eb3e93-3f02-48d3-a385-fbfcb6f1661d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "cinder-quobyte-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fef4d01-56e3-4baf-85be-3c34fe7870a1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:48 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d Nov 03 07:49:48 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:48 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:48 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d Nov 03 07:49:48 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:49 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-quobyte-00eb3e93-3f02-48d3-a385-fbfcb6f1661d" released by "delete_volume" :: held 0.652s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Created reservations ['2e26829f-285e-4ef2-be1c-43cc06de739b', '0828db6e-4bbe-41f2-aba3-5ac4154c0b8b', '3c6500cc-b67a-4d5b-b7c0-be76212d0346', '55046064-0f3d-4269-bae4-a0cc26eb86b2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:49 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:49 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:49 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Deleted volume successfully. Nov 03 07:49:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f6ccfe4-0444-4506-b9d2-894711fb0be2 tempest-VolumeDependencyTests-2025072446 None] Lock "cinder-00eb3e93-3f02-48d3-a385-fbfcb6f1661d-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:54 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:49:54 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:54 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Flow 'volume_create_manager' (643933fe-9ed7-4b96-a681-9d2d0139b078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8ec465-4317-4bd1-a01d-a46bc6e5bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8ec465-4317-4bd1-a01d-a46bc6e5bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd61f73-4a9c-4aec-8b74-39ffbee94b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523d6caf26574d87b42cbc00221dd7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:55Z,use_quota=True,user_id='4615ee6b85df4f3e90e0ffeeace6b8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc15da4-a076-44b5-9bce-f7d3348d7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc15da4-a076-44b5-9bce-f7d3348d7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feaa347-83b4-4235-9c4f-4113d5c60b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:54 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feaa347-83b4-4235-9c4f-4113d5c60b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3dd61f73-4a9c-4aec-8b74-39ffbee94b35', 'volume_name': 'volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35', 'volume_size': 1, 'image_id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/382f86e5-80fc-47b4-82c8-520f7415dfcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b20f920aebcad71d9d441bb45851b78b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '523d6caf26574d87b42cbc00221dd7d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af5e4b9f6bb98ea9ceece6bd8b49b4873508fb1534b1c9b0c9e2b7dab74c7ba18ec85de9cad4f9cd4696af49d87565b2dbcaee3af3ee3103d09ac86eb2b4dfc3', 'id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/382f86e5-80fc-47b4-82c8-520f7415dfcf/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482637a9-51dc-4c89-b356-e8f9a0e66389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482637a9-51dc-4c89-b356-e8f9a0e66389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4f0561-1883-495f-856b-ec0bdd630d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Volume 3dd61f73-4a9c-4aec-8b74-39ffbee94b35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35', 'volume_size': 1, 'image_id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/382f86e5-80fc-47b4-82c8-520f7415dfcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b20f920aebcad71d9d441bb45851b78b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '523d6caf26574d87b42cbc00221dd7d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af5e4b9f6bb98ea9ceece6bd8b49b4873508fb1534b1c9b0c9e2b7dab74c7ba18ec85de9cad4f9cd4696af49d87565b2dbcaee3af3ee3103d09ac86eb2b4dfc3', 'id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/382f86e5-80fc-47b4-82c8-520f7415dfcf/file', 'properties': {}}, 'image_service': } Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Trying to clone 3dd61f73-4a9c-4aec-8b74-39ffbee94b35 from image 382f86e5-80fc-47b4-82c8-520f7415dfcf at location (None, [{'url': 'file:///opt/stack/data/glance/images/382f86e5-80fc-47b4-82c8-520f7415dfcf', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:49:55 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5fe981-a673-4f81-8a20-5c2aebb614ab]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:55 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD Nov 03 07:49:55 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:55 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:55 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD Nov 03 07:49:55 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:55 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:55 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Temporary image 382f86e5-80fc-47b4-82c8-520f7415dfcf is fetched for user 4615ee6b85df4f3e90e0ffeeace6b8fa. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c03a8e-8d72-40a5-a2f6-e0975b0e8d52]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:56 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD Nov 03 07:49:56 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:56 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:56 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD Nov 03 07:49:56 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:56 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd61f73-4a9c-4aec-8b74-39ffbee94b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523d6caf26574d87b42cbc00221dd7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:55Z,use_quota=True,user_id='4615ee6b85df4f3e90e0ffeeace6b8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Creating volume 3dd61f73-4a9c-4aec-8b74-39ffbee94b35 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:56 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:56 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 1073741824 Nov 03 07:49:56 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:57 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 1073741824" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:57 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 Nov 03 07:49:57 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:57 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" returned: 0 in 0.229s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Attempting download of 382f86e5-80fc-47b4-82c8-520f7415dfcf ((None, [{'url': 'file:///opt/stack/data/glance/images/382f86e5-80fc-47b4-82c8-520f7415dfcf', 'metadata': {}}])) to volume 3dd61f73-4a9c-4aec-8b74-39ffbee94b35. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b85610e-a42d-488c-8232-4cb2facfc273]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:57 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10 Nov 03 07:49:57 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:57 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:57 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10 Nov 03 07:49:57 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:58 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10" returned: 1 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_382f86e5-80fc-47b4-82c8-520f7415dfcf_8h1tqc10' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f9565-c060-4a48-b506-5dcb176f3e0b]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:58 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD Nov 03 07:49:58 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:58 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:58 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD Nov 03 07:49:58 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:58 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD" returned: 1 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] 382f86e5-80fc-47b4-82c8-520f7415dfcf was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:49:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:58 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 Nov 03 07:49:58 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:59 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_382f86e5-80fc-47b4-82c8-520f7415dfcf_yd3zpwwwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:49:59 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:59 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 1G Nov 03 07:49:59 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:59 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 1G" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Downloaded image 382f86e5-80fc-47b4-82c8-520f7415dfcf ((None, [{'url': 'file:///opt/stack/data/glance/images/382f86e5-80fc-47b4-82c8-520f7415dfcf', 'metadata': {}}])) to volume 3dd61f73-4a9c-4aec-8b74-39ffbee94b35 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Temporary image 382f86e5-80fc-47b4-82c8-520f7415dfcf for user 4615ee6b85df4f3e90e0ffeeace6b8fa is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Marking volume 3dd61f73-4a9c-4aec-8b74-39ffbee94b35 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Copying metadata from image 382f86e5-80fc-47b4-82c8-520f7415dfcf to 3dd61f73-4a9c-4aec-8b74-39ffbee94b35. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Creating volume glance metadata for volume 3dd61f73-4a9c-4aec-8b74-39ffbee94b35 backed by image 382f86e5-80fc-47b4-82c8-520f7415dfcf with: {'image_id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b20f920aebcad71d9d441bb45851b78b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4f0561-1883-495f-856b-ec0bdd630d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35', 'volume_size': 1, 'image_id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/382f86e5-80fc-47b4-82c8-520f7415dfcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b20f920aebcad71d9d441bb45851b78b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '523d6caf26574d87b42cbc00221dd7d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af5e4b9f6bb98ea9ceece6bd8b49b4873508fb1534b1c9b0c9e2b7dab74c7ba18ec85de9cad4f9cd4696af49d87565b2dbcaee3af3ee3103d09ac86eb2b4dfc3', 'id': '382f86e5-80fc-47b4-82c8-520f7415dfcf', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/382f86e5-80fc-47b4-82c8-520f7415dfcf/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b7d58-a350-45d0-a8d0-e75d0f86aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Volume volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 (3dd61f73-4a9c-4aec-8b74-39ffbee94b35): created successfully Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b7d58-a350-45d0-a8d0-e75d0f86aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Flow 'volume_create_manager' (643933fe-9ed7-4b96-a681-9d2d0139b078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-09e1cbaf-bc5d-4d9b-a6ea-f02d9e4bea58 tempest-VolumeImageDependencyTests-769355068 None] Created volume successfully. Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Acquiring lock "cinder-3dd61f73-4a9c-4aec-8b74-39ffbee94b35-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Lock "cinder-3dd61f73-4a9c-4aec-8b74-39ffbee94b35-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Acquiring lock "cinder-quobyte-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Lock "cinder-quobyte-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4ec17-e46b-4230-ad4a-d66e454e8aac]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:00 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 Nov 03 07:50:00 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:00 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:00 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35 Nov 03 07:50:00 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:00 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Lock "cinder-quobyte-3dd61f73-4a9c-4aec-8b74-39ffbee94b35" released by "delete_volume" :: held 0.609s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Created reservations ['0219bec9-ed4e-4b62-a402-50cbc11535b8', 'c929257c-dfbe-45e8-9a6c-48a9656f7efe', 'eeea3446-786c-4c7b-a5df-32b1935dc5af', '11a85174-768d-4417-a0e5-016bddeeb1f7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:01 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:01 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:01 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Deleted volume successfully. Nov 03 07:50:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-549efd42-ed95-4c2b-924e-70b2b0822577 tempest-VolumeImageDependencyTests-769355068 None] Lock "cinder-3dd61f73-4a9c-4aec-8b74-39ffbee94b35-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=98,cinder:UPDATE=113,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=73,cinder:INSERT=35,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (6dd44f97-3a6e-44d7-89cd-111ee26d94e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67d9506-f652-46c0-aa7f-1969c7c06d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67d9506-f652-46c0-aa7f-1969c7c06d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397546342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc42255-dc42-4b95-adb2-cadffbbb1745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:09Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a654459c-bc87-4a04-8293-520a5762050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a654459c-bc87-4a04-8293-520a5762050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e1e41d-4409-40cf-8d6c-b555c0460815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e1e41d-4409-40cf-8d6c-b555c0460815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc42255-dc42-4b95-adb2-cadffbbb1745', 'volume_name': 'volume-5fc42255-dc42-4b95-adb2-cadffbbb1745', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877ea155-5ebe-4a09-bf94-7f9d185774e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877ea155-5ebe-4a09-bf94-7f9d185774e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f958c38-e51b-4734-942f-ae1704c120e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Volume 5fc42255-dc42-4b95-adb2-cadffbbb1745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc42255-dc42-4b95-adb2-cadffbbb1745', 'volume_size': 1} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397546342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc42255-dc42-4b95-adb2-cadffbbb1745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:09Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Creating volume 5fc42255-dc42-4b95-adb2-cadffbbb1745 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:08 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 1073741824 Nov 03 07:50:08 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:09 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 1073741824" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:09 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 Nov 03 07:50:09 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:09 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f958c38-e51b-4734-942f-ae1704c120e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc42255-dc42-4b95-adb2-cadffbbb1745', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acf9395-1389-4b5a-8568-27de5e79b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Volume volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 (5fc42255-dc42-4b95-adb2-cadffbbb1745): created successfully Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acf9395-1389-4b5a-8568-27de5e79b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (6dd44f97-3a6e-44d7-89cd-111ee26d94e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7d2065ac-7a30-42ef-8289-8734e6374ee4 tempest-ProjectReaderTests-169899596 None] Created volume successfully. Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-5fc42255-dc42-4b95-adb2-cadffbbb1745-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Lock "cinder-5fc42255-dc42-4b95-adb2-cadffbbb1745-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-quobyte-5fc42255-dc42-4b95-adb2-cadffbbb1745" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-5fc42255-dc42-4b95-adb2-cadffbbb1745" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cf8318-a633-4c66-ab6f-c9bc8dfbe8e4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:09 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 Nov 03 07:50:09 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:10 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:10 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745 Nov 03 07:50:10 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:10 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fc42255-dc42-4b95-adb2-cadffbbb1745" returned: 0 in 0.233s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-5fc42255-dc42-4b95-adb2-cadffbbb1745" released by "delete_volume" :: held 0.608s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Created reservations ['70d42f67-7085-4320-b604-43b1ea7584c7', 'ff16139c-4969-4084-9f5a-61ebd6eb8549', '36eecc7d-e490-4f7f-800f-5a2882397ff3', 'c02eb0e9-2fd6-45e5-87e2-88620bb896e4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:10 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:10 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:10 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.228s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Deleted volume successfully. Nov 03 07:50:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa4a71e1-e6c2-405b-a3de-78527dd45319 tempest-ProjectReaderTests-169899596 None] Lock "cinder-5fc42255-dc42-4b95-adb2-cadffbbb1745-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (9f4d9376-5044-4cbc-87d6-8e56ca9dec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0f8486-bacc-4c03-a58c-e0572746523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0f8486-bacc-4c03-a58c-e0572746523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020648612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb5b81a-f559-4d23-9999-bd84934467b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:11Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2918b39-c221-42b2-a7d5-57a090042bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2918b39-c221-42b2-a7d5-57a090042bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3847ecc-3068-4ad0-8328-32083f5b6bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3847ecc-3068-4ad0-8328-32083f5b6bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb5b81a-f559-4d23-9999-bd84934467b9', 'volume_name': 'volume-9eb5b81a-f559-4d23-9999-bd84934467b9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbcff36-485b-4cff-9528-e1f4d019b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbcff36-485b-4cff-9528-e1f4d019b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c9b472-9b35-4393-b8af-0edae333b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Volume 9eb5b81a-f559-4d23-9999-bd84934467b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb5b81a-f559-4d23-9999-bd84934467b9', 'volume_size': 1} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020648612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb5b81a-f559-4d23-9999-bd84934467b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:11Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Creating volume 9eb5b81a-f559-4d23-9999-bd84934467b9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 1073741824 Nov 03 07:50:11 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:11 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 1073741824" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 Nov 03 07:50:11 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9" returned: 0 in 0.247s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c9b472-9b35-4393-b8af-0edae333b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb5b81a-f559-4d23-9999-bd84934467b9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3346a417-171c-4670-896a-d7ed7c276715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Volume volume-9eb5b81a-f559-4d23-9999-bd84934467b9 (9eb5b81a-f559-4d23-9999-bd84934467b9): created successfully Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3346a417-171c-4670-896a-d7ed7c276715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (9f4d9376-5044-4cbc-87d6-8e56ca9dec0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1abe3110-7de4-4507-bb60-cbde7c34710d tempest-ProjectReaderTests-169899596 None] Created volume successfully. Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-9eb5b81a-f559-4d23-9999-bd84934467b9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Lock "cinder-9eb5b81a-f559-4d23-9999-bd84934467b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-quobyte-9eb5b81a-f559-4d23-9999-bd84934467b9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-9eb5b81a-f559-4d23-9999-bd84934467b9" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14cc61-c8b5-4e55-8120-9ee6afd6aaaf]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 Nov 03 07:50:12 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9 Nov 03 07:50:12 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9eb5b81a-f559-4d23-9999-bd84934467b9" returned: 0 in 0.232s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-9eb5b81a-f559-4d23-9999-bd84934467b9" released by "delete_volume" :: held 0.622s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Created reservations ['97613e8f-4f8a-4ca3-8091-192c18dc4d0c', '34ea67ca-e28a-4cb0-8d21-1998cb67b5e0', 'd5f87e4b-33e8-40e8-8ec6-7e9591f8bbaa', '6e57e538-ef55-48af-8abb-8a2d229bcbdf'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:13 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Deleted volume successfully. Nov 03 07:50:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5863c6fc-0d32-490e-91ae-252f7dcc7b71 tempest-ProjectReaderTests-169899596 None] Lock "cinder-9eb5b81a-f559-4d23-9999-bd84934467b9-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (43924680-dd06-4270-b70a-f824f154f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9982edf2-b01e-43f4-8390-350552d570db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9982edf2-b01e-43f4-8390-350552d570db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44766642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c81a5b8-b2f9-4b15-a533-647536dea2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:14Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73cf370-a1e3-4606-b7ea-e914f10b421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73cf370-a1e3-4606-b7ea-e914f10b421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a326d98-a28d-4ccf-8e78-7836e119db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a326d98-a28d-4ccf-8e78-7836e119db1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c81a5b8-b2f9-4b15-a533-647536dea2c5', 'volume_name': 'volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ced3bd8-c511-4d3a-96bd-7c30dd6b9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ced3bd8-c511-4d3a-96bd-7c30dd6b9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07996d7-01f1-46af-9f1b-38bd376bb355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Volume 8c81a5b8-b2f9-4b15-a533-647536dea2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5', 'volume_size': 1} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44766642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c81a5b8-b2f9-4b15-a533-647536dea2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:14Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Creating volume 8c81a5b8-b2f9-4b15-a533-647536dea2c5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:14 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 1073741824 Nov 03 07:50:14 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:14 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 1073741824" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:14 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 Nov 03 07:50:14 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:14 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5" returned: 0 in 0.230s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07996d7-01f1-46af-9f1b-38bd376bb355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d23333-46b7-42d4-a54a-5c49942651b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Volume volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 (8c81a5b8-b2f9-4b15-a533-647536dea2c5): created successfully Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d23333-46b7-42d4-a54a-5c49942651b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (43924680-dd06-4270-b70a-f824f154f5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3e53e73d-3bf4-417a-8a32-b19800b6d7fc tempest-ProjectReaderTests-169899596 None] Created volume successfully. Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-8c81a5b8-b2f9-4b15-a533-647536dea2c5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Lock "cinder-8c81a5b8-b2f9-4b15-a533-647536dea2c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-quobyte-8c81a5b8-b2f9-4b15-a533-647536dea2c5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-8c81a5b8-b2f9-4b15-a533-647536dea2c5" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6106f87-ec03-4984-9811-de0aad9a19cc]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 Nov 03 07:50:15 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5" returned: 0 in 0.345s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5 Nov 03 07:50:15 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-8c81a5b8-b2f9-4b15-a533-647536dea2c5" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-8c81a5b8-b2f9-4b15-a533-647536dea2c5" released by "delete_volume" :: held 0.613s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Created reservations ['def3fd44-0f85-4fe3-ae13-046026f9985e', '4934b88c-3eec-4599-bd3d-032a8c862edd', 'daa79b2d-300f-4654-86e3-2d116730174e', '163a18fa-e095-429b-92eb-f133578aa7fe'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:15 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.228s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Deleted volume successfully. Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7205b653-d4a8-43f7-9eb5-4aca3779a7a3 tempest-ProjectReaderTests-169899596 None] Lock "cinder-8c81a5b8-b2f9-4b15-a533-647536dea2c5-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (b8d9a686-22da-461e-a2db-fe72cd405d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f2799-92a1-4b54-b487-1a1b90c75367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113f2799-92a1-4b54-b487-1a1b90c75367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774486314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239d83d5-ef61-439a-8c31-d6f57de66bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:17Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684a85af-fb79-4a8f-9a07-6e8d8a156645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684a85af-fb79-4a8f-9a07-6e8d8a156645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccad709-f9bd-499b-8569-7c20a74075af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccad709-f9bd-499b-8569-7c20a74075af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239d83d5-ef61-439a-8c31-d6f57de66bb1', 'volume_name': 'volume-239d83d5-ef61-439a-8c31-d6f57de66bb1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ec77c5-774b-45a8-b6b8-fc999744e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ec77c5-774b-45a8-b6b8-fc999744e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5f2460-0eea-4a02-bb83-417d2bf59ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Volume 239d83d5-ef61-439a-8c31-d6f57de66bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239d83d5-ef61-439a-8c31-d6f57de66bb1', 'volume_size': 1} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774486314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239d83d5-ef61-439a-8c31-d6f57de66bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141d34501f245319bd99a8179815e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:17Z,use_quota=True,user_id='aa059dd81a934561953dc895b4440098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Creating volume 239d83d5-ef61-439a-8c31-d6f57de66bb1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:16 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 1073741824 Nov 03 07:50:16 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:17 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 1073741824" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:17 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 Nov 03 07:50:17 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:17 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1" returned: 0 in 0.227s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5f2460-0eea-4a02-bb83-417d2bf59ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239d83d5-ef61-439a-8c31-d6f57de66bb1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f113cb4-eb16-4e87-9393-12f52ba08c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Volume volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 (239d83d5-ef61-439a-8c31-d6f57de66bb1): created successfully Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f113cb4-eb16-4e87-9393-12f52ba08c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Flow 'volume_create_manager' (b8d9a686-22da-461e-a2db-fe72cd405d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7404660d-86f1-4fb7-a828-95c3dc17dddc tempest-ProjectReaderTests-169899596 None] Created volume successfully. Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-239d83d5-ef61-439a-8c31-d6f57de66bb1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Lock "cinder-239d83d5-ef61-439a-8c31-d6f57de66bb1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Acquiring lock "cinder-quobyte-239d83d5-ef61-439a-8c31-d6f57de66bb1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-239d83d5-ef61-439a-8c31-d6f57de66bb1" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe917a1-36fe-4e84-8afd-d59c0252710f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:17 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 Nov 03 07:50:17 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:18 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:18 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1 Nov 03 07:50:18 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:18 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-239d83d5-ef61-439a-8c31-d6f57de66bb1" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Lock "cinder-quobyte-239d83d5-ef61-439a-8c31-d6f57de66bb1" released by "delete_volume" :: held 0.660s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Created reservations ['56878dad-309a-403c-a665-014a6366920d', '115b06a1-9d2c-4788-88f4-9b09b9f82673', '171b6eb3-46f0-42e0-b58f-f1ca904899b1', '699bdc00-b7e8-4c14-8e76-fc82d3e1b8fc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:18 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:18 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:18 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.248s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Deleted volume successfully. Nov 03 07:50:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0d156a8-33c8-4d6c-83e3-cec50685c525 tempest-ProjectReaderTests-169899596 None] Lock "cinder-239d83d5-ef61-439a-8c31-d6f57de66bb1-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=29,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:50:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=44,cinder:INSERT=12,cinder:SELECT=26,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Flow 'volume_create_manager' (ea498e2e-d206-49c1-9555-27602509ec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852ded8b-ad59-4c23-bdc7-d08e704c5af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852ded8b-ad59-4c23-bdc7-d08e704c5af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1227471501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0247b039-21cd-40d3-af51-d80b31320414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f6e27d90c844a59386fbd97aa659d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:31Z,use_quota=True,user_id='ce55d667aff14a1282232bcb49bce501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdcc05b-0c94-41e9-a836-81dac2625606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdcc05b-0c94-41e9-a836-81dac2625606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fc143b-cd3a-416a-9f4b-b24aaa3c9e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fc143b-cd3a-416a-9f4b-b24aaa3c9e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0247b039-21cd-40d3-af51-d80b31320414', 'volume_name': 'volume-0247b039-21cd-40d3-af51-d80b31320414', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383d5517-86d8-4913-a135-eb82133067af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383d5517-86d8-4913-a135-eb82133067af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352efa70-5c95-443b-a0c9-ea0e1e1bcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Volume 0247b039-21cd-40d3-af51-d80b31320414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0247b039-21cd-40d3-af51-d80b31320414', 'volume_size': 1} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1227471501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0247b039-21cd-40d3-af51-d80b31320414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f6e27d90c844a59386fbd97aa659d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:31Z,use_quota=True,user_id='ce55d667aff14a1282232bcb49bce501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Creating volume 0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:31 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:31 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 1073741824 Nov 03 07:50:31 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (8f9078d7-1a0e-46e5-a2ff-1c3b38a7bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7355008b-cbb4-49fa-beb1-0b893861580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7355008b-cbb4-49fa-beb1-0b893861580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765911247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff703f-212e-45f8-9786-e56f1ead1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:31Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19105622-81b4-4bb6-8bfb-d8f1c61e140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19105622-81b4-4bb6-8bfb-d8f1c61e140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec89d95-7f13-4a87-93e9-20b03d34cf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec89d95-7f13-4a87-93e9-20b03d34cf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ff703f-212e-45f8-9786-e56f1ead1942', 'volume_name': 'volume-41ff703f-212e-45f8-9786-e56f1ead1942', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bcd841-43a6-455e-8a1a-5c7695a8da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bcd841-43a6-455e-8a1a-5c7695a8da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8466726-a9da-4dbd-9437-5e3cbd8d19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume 41ff703f-212e-45f8-9786-e56f1ead1942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ff703f-212e-45f8-9786-e56f1ead1942', 'volume_size': 1} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (c1aa6f62-5a3d-4448-b694-f3b62b50d766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe363bd-ae0e-46d1-ba67-021b463ac8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe363bd-ae0e-46d1-ba67-021b463ac8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1563621793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd7b156-e02f-4256-8d86-2422edf35d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:32Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57601d66-038b-495b-b2cb-4f884eaf37b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57601d66-038b-495b-b2cb-4f884eaf37b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef16485-4f4f-4eb4-8c66-70c66d78961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef16485-4f4f-4eb4-8c66-70c66d78961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd7b156-e02f-4256-8d86-2422edf35d5a', 'volume_name': 'volume-9fd7b156-e02f-4256-8d86-2422edf35d5a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbfbd18-a577-4e97-8f88-36fcf8241a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbfbd18-a577-4e97-8f88-36fcf8241a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec22241d-ebed-4687-b400-949a679dfd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume 9fd7b156-e02f-4256-8d86-2422edf35d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd7b156-e02f-4256-8d86-2422edf35d5a', 'volume_size': 1} Nov 03 07:50:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:32 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 1073741824" returned: 0 in 0.587s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:32 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 Nov 03 07:50:32 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:32 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765911247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff703f-212e-45f8-9786-e56f1ead1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:31Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Creating volume 41ff703f-212e-45f8-9786-e56f1ead1942 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352efa70-5c95-443b-a0c9-ea0e1e1bcb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0247b039-21cd-40d3-af51-d80b31320414', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 1073741824 Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01eeb7e-70c4-4234-a4a9-1f1e239b994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Volume volume-0247b039-21cd-40d3-af51-d80b31320414 (0247b039-21cd-40d3-af51-d80b31320414): created successfully Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01eeb7e-70c4-4234-a4a9-1f1e239b994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Flow 'volume_create_manager' (ea498e2e-d206-49c1-9555-27602509ec33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7668fa73-12c6-4499-b52f-7028074d2231 tempest-VolumeDependencyTests-2013743992 None] Created volume successfully. Nov 03 07:50:32 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 1073741824" returned: 0 in 0.480s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:32 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 Nov 03 07:50:32 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1563621793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd7b156-e02f-4256-8d86-2422edf35d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:32Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating volume 9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8466726-a9da-4dbd-9437-5e3cbd8d19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ff703f-212e-45f8-9786-e56f1ead1942', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a 1073741824 Nov 03 07:50:33 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ed03b3-d145-4cdb-939e-944b34ce99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume volume-41ff703f-212e-45f8-9786-e56f1ead1942 (41ff703f-212e-45f8-9786-e56f1ead1942): created successfully Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ed03b3-d145-4cdb-939e-944b34ce99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (8f9078d7-1a0e-46e5-a2ff-1c3b38a7bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b8d3f8b8-c39e-4f3f-af21-587fb18f9964 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created volume successfully. Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:33 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a 1073741824" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:33 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a Nov 03 07:50:33 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.511s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec22241d-ebed-4687-b400-949a679dfd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd7b156-e02f-4256-8d86-2422edf35d5a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18186f80-0540-4265-b4e2-126f654ad1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Creating offline snapshot 461c564b-46da-4092-825e-600c0d6a7d2e of volume 0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume volume-9fd7b156-e02f-4256-8d86-2422edf35d5a (9fd7b156-e02f-4256-8d86-2422edf35d5a): created successfully Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18186f80-0540-4265-b4e2-126f654ad1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (c1aa6f62-5a3d-4448-b694-f3b62b50d766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde7a102-6e13-4a33-be05-81c56e991bab]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-11e1fb4b-49bd-4dc3-9787-3c610aafa6fe tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created volume successfully. Nov 03 07:50:34 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 Nov 03 07:50:34 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:34 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:34 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e 1G Nov 03 07:50:34 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (a140a691-c4e2-47ac-b04e-c37abad85de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3101ea5a-e310-4609-ba67-888f97b46195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3101ea5a-e310-4609-ba67-888f97b46195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1459358142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9636b80-53d4-4a9c-9088-5def309433b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3406094f-c03f-4493-8a2c-71d9b604d691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3406094f-c03f-4493-8a2c-71d9b604d691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366287db-b5a4-46f9-a163-3dad156a1ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366287db-b5a4-46f9-a163-3dad156a1ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9636b80-53d4-4a9c-9088-5def309433b1', 'volume_name': 'volume-c9636b80-53d4-4a9c-9088-5def309433b1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daf0d8c-b769-4d2e-adaa-cbc86afbab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daf0d8c-b769-4d2e-adaa-cbc86afbab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fdae64-fc07-4713-8725-dcc14cf9eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume c9636b80-53d4-4a9c-9088-5def309433b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9636b80-53d4-4a9c-9088-5def309433b1', 'volume_size': 1} Nov 03 07:50:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e 1G" returned: 0 in 0.594s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0247b039-21cd-40d3-af51-d80b31320414 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0247b039-21cd-40d3-af51-d80b31320414 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e Nov 03 07:50:35 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Flow 'volume_create_manager' (0ee9e98c-d275-4e95-9395-4d88d9703759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac623f1-452e-401f-93f4-7d347e3067b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac623f1-452e-401f-93f4-7d347e3067b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b4ca0ecaee4721bec8344a3fe342b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='d2595878ac614e3785d1605b01d75ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3a671f2-f772-4cf0-9f24-1409dfaf152d),volume_type_id=a3a671f2-f772-4cf0-9f24-1409dfaf152d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7fe124-b1fa-4c14-8164-6fb66732d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7fe124-b1fa-4c14-8164-6fb66732d45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fffa96a-bebc-4a95-a790-42c071ec1c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:50:35 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0247b039-21cd-40d3-af51-d80b31320414 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e is being set with open permissions: ugo+rw Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (b30fc823-b339-4e51-a7d2-30ee0b16a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1a4bf8-4291-4005-901f-1da6c210aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1a4bf8-4291-4005-901f-1da6c210aa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1672415463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dee082-1222-4ae8-a44b-66e096828199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ca07e1-d030-4157-bfd4-f0011f175c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ca07e1-d030-4157-bfd4-f0011f175c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acef1db-8716-4833-99ef-a915fd4417af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acef1db-8716-4833-99ef-a915fd4417af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5dee082-1222-4ae8-a44b-66e096828199', 'volume_name': 'volume-d5dee082-1222-4ae8-a44b-66e096828199', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a77549e-c6eb-4f51-a601-311c3eaae351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a77549e-c6eb-4f51-a601-311c3eaae351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b3029a-2b9d-4039-ba8a-acf72217e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume d5dee082-1222-4ae8-a44b-66e096828199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5dee082-1222-4ae8-a44b-66e096828199', 'volume_size': 1} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fffa96a-bebc-4a95-a790-42c071ec1c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e', 'volume_name': 'volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e', 'volume_size': 1, 'image_id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fa3493c1fd50bf3385bd5b06c51c394', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0b4ca0ecaee4721bec8344a3fe342b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '324199b6157596617fc2e5a8d13d78c25e6791b721e64c72fcd3b1ee5835d85e3ea72b77fb52a13d714da5dc8c07e5e876cccd53eca76cb58929b36f3d408061', 'id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ef1895-30c8-4da7-a819-30e1c3aad101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ef1895-30c8-4da7-a819-30e1c3aad101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e70037-4db5-4a44-a0aa-66431c799d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Volume 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e', 'volume_size': 1, 'image_id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fa3493c1fd50bf3385bd5b06c51c394', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0b4ca0ecaee4721bec8344a3fe342b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '324199b6157596617fc2e5a8d13d78c25e6791b721e64c72fcd3b1ee5835d85e3ea72b77fb52a13d714da5dc8c07e5e876cccd53eca76cb58929b36f3d408061', 'id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Trying to clone 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e from image 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:50:35 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:50:35 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:35 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info Nov 03 07:50:35 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (7c2b8673-8982-4950-a9f0-9c1b086b33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e34c743-5084-4a2c-9405-451d8af37c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d863b3d-21a7-4d39-9f60-d92c48b706de]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e34c743-5084-4a2c-9405-451d8af37c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818045905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7edeaab-73bf-4b49-92aa-59be29fc0d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:36Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a204270e-655e-4c0b-bc0f-d664fb31e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a204270e-655e-4c0b-bc0f-d664fb31e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c864d631-543d-484b-a21f-923fc333e1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c864d631-543d-484b-a21f-923fc333e1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7edeaab-73bf-4b49-92aa-59be29fc0d0f', 'volume_name': 'volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25324666-ac89-40e0-8894-4aeb87e1ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25324666-ac89-40e0-8894-4aeb87e1ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0060b3-6bd5-4aaa-9663-123ecf065bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume f7edeaab-73bf-4b49-92aa-59be29fc0d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f', 'volume_size': 1} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:36 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD Nov 03 07:50:36 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info" returned: 0 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info is being set with open permissions: ugo+rw Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:36 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info Nov 03 07:50:36 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (3fb0a2c1-7156-47fb-b524-b0ffd65eca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926eb42d-99eb-4ded-a0bc-c9bb5c15eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926eb42d-99eb-4ded-a0bc-c9bb5c15eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1906628421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa93067-bc4b-434c-94cd-c199dcde38eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:36Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04641849-4bc8-4ec2-aab0-b67ae890798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04641849-4bc8-4ec2-aab0-b67ae890798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acd0a29-56d4-4ef4-b258-81edebf3f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD Nov 03 07:50:36 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acd0a29-56d4-4ef4-b258-81edebf3f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa93067-bc4b-434c-94cd-c199dcde38eb', 'volume_name': 'volume-5fa93067-bc4b-434c-94cd-c199dcde38eb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a13dfb7-fc6a-4ca1-9bb9-c0b8b9dd46dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a13dfb7-fc6a-4ca1-9bb9-c0b8b9dd46dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc10ef4f-ceff-43af-bcfe-0576de582881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume 5fa93067-bc4b-434c-94cd-c199dcde38eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa93067-bc4b-434c-94cd-c199dcde38eb', 'volume_size': 1} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:36 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.info" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1459358142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9636b80-53d4-4a9c-9088-5def309433b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Creating volume c9636b80-53d4-4a9c-9088-5def309433b1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-94271aea-7162-4d5c-acfd-911ec33a6fc0 tempest-VolumeDependencyTests-2013743992 None] Create snapshot completed successfully Nov 03 07:50:36 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 1073741824 Nov 03 07:50:36 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Temporary image 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 is fetched for user d2595878ac614e3785d1605b01d75ec8. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (5364143a-90e2-4504-8699-da5dd97ae98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8048a2e-92c5-4871-96ac-1399a766cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8048a2e-92c5-4871-96ac-1399a766cd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827304737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1f9469-9ff4-4891-91f4-868c2fa5b92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:37Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e105cde9-0fcd-44d0-b84d-6d973bcb9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e105cde9-0fcd-44d0-b84d-6d973bcb9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f420b152-3f2f-49b1-9de7-ada8ee0d045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f420b152-3f2f-49b1-9de7-ada8ee0d045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1f9469-9ff4-4891-91f4-868c2fa5b92e', 'volume_name': 'volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44b2b95-accc-467c-9b40-6f8e33c16ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44b2b95-accc-467c-9b40-6f8e33c16ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8f8b36-9c68-4913-b986-d8a9a883b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume 0b1f9469-9ff4-4891-91f4-868c2fa5b92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e', 'volume_size': 1} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2e04d-f7e4-4397-8aee-d94692ecb9de]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:37 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD Nov 03 07:50:37 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:37 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 1073741824" returned: 0 in 0.568s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:37 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 Nov 03 07:50:37 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:37 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Flow 'volume_create_manager' (bf502922-2c34-4b48-a147-0761955ce2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810b9055-f64b-4fed-a545-d97c2ee001a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810b9055-f64b-4fed-a545-d97c2ee001a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1085816101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827c5978-9ecf-4006-9c7d-24ee510918b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f6e27d90c844a59386fbd97aa659d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=461c564b-46da-4092-825e-600c0d6a7d2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:37Z,use_quota=True,user_id='ce55d667aff14a1282232bcb49bce501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94d1e57-f2cb-4754-9ff6-3f444435f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94d1e57-f2cb-4754-9ff6-3f444435f79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD Nov 03 07:50:37 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3331fc63-5b55-41d8-9b58-6ec34aeae77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3331fc63-5b55-41d8-9b58-6ec34aeae77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '827c5978-9ecf-4006-9c7d-24ee510918b5', 'volume_name': 'volume-827c5978-9ecf-4006-9c7d-24ee510918b5', 'volume_size': 1, 'snapshot_id': '461c564b-46da-4092-825e-600c0d6a7d2e'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc5acd-c681-47e2-b477-ea587a079783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc5acd-c681-47e2-b477-ea587a079783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3419bbf4-7522-4859-b334-617ac55bd238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Volume 827c5978-9ecf-4006-9c7d-24ee510918b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-827c5978-9ecf-4006-9c7d-24ee510918b5', 'volume_size': 1, 'snapshot_id': '461c564b-46da-4092-825e-600c0d6a7d2e'} Nov 03 07:50:37 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.962s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fdae64-fc07-4713-8725-dcc14cf9eb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9636b80-53d4-4a9c-9088-5def309433b1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715da599-ee74-41ec-91c8-895435157c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume volume-c9636b80-53d4-4a9c-9088-5def309433b1 (c9636b80-53d4-4a9c-9088-5def309433b1): created successfully Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715da599-ee74-41ec-91c8-895435157c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (a140a691-c4e2-47ac-b04e-c37abad85de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating offline snapshot 41562145-eee3-48fb-8779-24ba99e81d13 of volume 9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c0982-ce15-4445-b00f-23950ed5716f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cf23326a-6557-421d-9e14-bfbaf0ffaf37 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created volume successfully. Nov 03 07:50:37 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:37 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:37 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 1G Nov 03 07:50:38 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 1G" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd7b156-e02f-4256-8d86-2422edf35d5a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd7b156-e02f-4256-8d86-2422edf35d5a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 Nov 03 07:50:38 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd7b156-e02f-4256-8d86-2422edf35d5a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13" returned: 0 in 0.287s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 is being set with open permissions: ugo+rw Nov 03 07:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 Nov 03 07:50:38 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13" returned: 0 in 0.246s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info Nov 03 07:50:38 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info is being set with open permissions: ugo+rw Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info Nov 03 07:50:39 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.info" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.860s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1672415463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dee082-1222-4ae8-a44b-66e096828199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Creating volume d5dee082-1222-4ae8-a44b-66e096828199 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 1073741824 Nov 03 07:50:39 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8af9533b-4261-4a7f-8463-44abb6e41c3b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Create snapshot completed successfully Nov 03 07:50:39 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 1073741824" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 Nov 03 07:50:39 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199" returned: 0 in 0.234s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.174s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818045905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7edeaab-73bf-4b49-92aa-59be29fc0d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:36Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Creating volume f7edeaab-73bf-4b49-92aa-59be29fc0d0f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b3029a-2b9d-4039-ba8a-acf72217e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5dee082-1222-4ae8-a44b-66e096828199', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:40 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f 1073741824 Nov 03 07:50:40 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef566faf-7396-4308-b4d5-531514ff9b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume volume-d5dee082-1222-4ae8-a44b-66e096828199 (d5dee082-1222-4ae8-a44b-66e096828199): created successfully Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef566faf-7396-4308-b4d5-531514ff9b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (b30fc823-b339-4e51-a7d2-30ee0b16a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3301e4cc-c3ef-442a-b903-fbbb55c11b4a tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created volume successfully. Nov 03 07:50:40 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f 1073741824" returned: 0 in 0.451s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f Nov 03 07:50:40 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.492s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1906628421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa93067-bc4b-434c-94cd-c199dcde38eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:36Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Creating volume 5fa93067-bc4b-434c-94cd-c199dcde38eb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0060b3-6bd5-4aaa-9663-123ecf065bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb 1073741824 Nov 03 07:50:41 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d47282-96c1-4bb4-896f-2956df63f042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (08f45297-b905-4333-b5ed-1adc71b0a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c808b9-5423-4b69-86e3-a6db10a10349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c808b9-5423-4b69-86e3-a6db10a10349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889088308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526ded2e-1f32-46ce-937c-7eebffdaec33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:41Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a88203-ff98-4398-a9a7-98e2d9780362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a88203-ff98-4398-a9a7-98e2d9780362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ce29ad-af3e-4c37-875c-f55f1ce58557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ce29ad-af3e-4c37-875c-f55f1ce58557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526ded2e-1f32-46ce-937c-7eebffdaec33', 'volume_name': 'volume-526ded2e-1f32-46ce-937c-7eebffdaec33', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d54ee78-36e4-48ba-945f-1ca9d9bb48cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d54ee78-36e4-48ba-945f-1ca9d9bb48cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2abf98-cd7b-4e19-a327-8ac538cc3ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume 526ded2e-1f32-46ce-937c-7eebffdaec33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526ded2e-1f32-46ce-937c-7eebffdaec33', 'volume_size': 1} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f (f7edeaab-73bf-4b49-92aa-59be29fc0d0f): created successfully Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d47282-96c1-4bb4-896f-2956df63f042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (7c2b8673-8982-4950-a9f0-9c1b086b33ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6d7f2466-bdb5-4d86-bf6b-16a1b820a42e tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created volume successfully. Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (ccd9f9de-661a-4f60-97d2-ecab22b3b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bce902-e0e4-4ab5-927d-cb770be38586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bce902-e0e4-4ab5-927d-cb770be38586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533235478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fff704-5244-4d4c-a321-fc6d251f634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:41Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c69607a-38b6-4607-bec1-310fe12a128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c69607a-38b6-4607-bec1-310fe12a128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f21d8f-0b0a-4172-9d68-b8b0c72f9f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f21d8f-0b0a-4172-9d68-b8b0c72f9f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fff704-5244-4d4c-a321-fc6d251f634a', 'volume_name': 'volume-e0fff704-5244-4d4c-a321-fc6d251f634a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d954be7-fe0b-4227-9bb1-a81052d6b055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d954be7-fe0b-4227-9bb1-a81052d6b055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba9d9a0-c02d-4abe-b9c0-81d189fa404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume e0fff704-5244-4d4c-a321-fc6d251f634a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fff704-5244-4d4c-a321-fc6d251f634a', 'volume_size': 1} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb 1073741824" returned: 0 in 0.545s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb Nov 03 07:50:41 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (e19de3ae-dbcf-41ce-b39a-241a60c6e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8dc4e0-bf40-4ce9-8b6f-c1f4c9162001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8dc4e0-bf40-4ce9-8b6f-c1f4c9162001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467981681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8509dd4-603e-4d61-bb2f-c8320a28bdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:42Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa791a76-dc86-4d9f-9230-faf750f861ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa791a76-dc86-4d9f-9230-faf750f861ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1bdeeb-7a62-4f3a-8364-85e91580c417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1bdeeb-7a62-4f3a-8364-85e91580c417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8509dd4-603e-4d61-bb2f-c8320a28bdf0', 'volume_name': 'volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d0e68a-df32-438f-a308-5682d82d6bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d0e68a-df32-438f-a308-5682d82d6bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42983b3-73cd-4d28-a17b-272ca0c352f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume a8509dd4-603e-4d61-bb2f-c8320a28bdf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0', 'volume_size': 1} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827304737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1f9469-9ff4-4891-91f4-868c2fa5b92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235681099dc549bdaf5a94b4dcc712d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:37Z,use_quota=True,user_id='63109d6370bb4202ba8ddb4b0aa23402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Creating volume 0b1f9469-9ff4-4891-91f4-868c2fa5b92e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc10ef4f-ceff-43af-bcfe-0576de582881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa93067-bc4b-434c-94cd-c199dcde38eb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d782e17-23a0-48be-af32-6926bc1b9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e 1073741824 Nov 03 07:50:41 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume volume-5fa93067-bc4b-434c-94cd-c199dcde38eb (5fa93067-bc4b-434c-94cd-c199dcde38eb): created successfully Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d782e17-23a0-48be-af32-6926bc1b9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (3fb0a2c1-7156-47fb-b524-b0ffd65eca00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4b0c0adb-6829-45d3-b9df-3e69f27994bb tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created volume successfully. Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (4b3176f6-4f5a-4134-a7d8-bd4eac721b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf17521f-98cd-414c-b427-ef1fabc0acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf17521f-98cd-414c-b427-ef1fabc0acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412441886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f0942d-e082-4b62-99f8-11a4e27d8a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:42Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae44e86a-6186-44ee-8b53-301ef9e971f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae44e86a-6186-44ee-8b53-301ef9e971f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96323d0d-2b14-4c19-aeb7-5b81863493ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96323d0d-2b14-4c19-aeb7-5b81863493ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f0942d-e082-4b62-99f8-11a4e27d8a63', 'volume_name': 'volume-93f0942d-e082-4b62-99f8-11a4e27d8a63', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb7fea1-9c5a-4751-af5f-a226235b1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb7fea1-9c5a-4751-af5f-a226235b1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed49bc5-08d4-4083-b917-0add3d6bbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume 93f0942d-e082-4b62-99f8-11a4e27d8a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f0942d-e082-4b62-99f8-11a4e27d8a63', 'volume_size': 1} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:42 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e 1073741824" returned: 0 in 0.535s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:42 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e Nov 03 07:50:42 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (e843c3c7-d806-4a06-8d3f-f56c72c22bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6f40f2-3a86-4b68-b141-35e139953b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6f40f2-3a86-4b68-b141-35e139953b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277852676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79457f0-a5c8-4a51-a2d6-5ec89f2d6040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:43Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69a033d-5bd9-4521-b245-37e51710edaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69a033d-5bd9-4521-b245-37e51710edaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1e4ccb-8521-4c97-84ee-33f302722c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1e4ccb-8521-4c97-84ee-33f302722c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79457f0-a5c8-4a51-a2d6-5ec89f2d6040', 'volume_name': 'volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab92f30f-64a7-47d6-a0a0-6ed11cddc811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab92f30f-64a7-47d6-a0a0-6ed11cddc811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d895a609-634e-4539-a3b6-c2427606cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume c79457f0-a5c8-4a51-a2d6-5ec89f2d6040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040', 'volume_size': 1} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:42 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e" returned: 0 in 0.247s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.240s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-quobyte-461c564b-46da-4092-825e-600c0d6a7d2e-827c5978-9ecf-4006-9c7d-24ee510918b5" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8f8b36-9c68-4913-b986-d8a9a883b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3393ce0e-3f11-453d-bbdb-38150a1c330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-461c564b-46da-4092-825e-600c0d6a7d2e-827c5978-9ecf-4006-9c7d-24ee510918b5" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Creating volume 827c5978-9ecf-4006-9c7d-24ee510918b5 from snapshot 461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-quobyte-827c5978-9ecf-4006-9c7d-24ee510918b5" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Volume volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e (0b1f9469-9ff4-4891-91f4-868c2fa5b92e): created successfully Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3393ce0e-3f11-453d-bbdb-38150a1c330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Flow 'volume_create_manager' (5364143a-90e2-4504-8699-da5dd97ae98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-827c5978-9ecf-4006-9c7d-24ee510918b5" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] snapshot: 461c564b-46da-4092-825e-600c0d6a7d2e, volume: 827c5978-9ecf-4006-9c7d-24ee510918b5, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:50:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-467e5e08-7943-4ff6-8376-1578eb676908 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created volume successfully. Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5341afc-ac66-4334-a3c7-46c947cd0b5a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:42 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e Nov 03 07:50:42 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0247b039-21cd-40d3-af51-d80b31320414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[81220f67-cafa-4f60-84e5-f9aee64abc75]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 Nov 03 07:50:43 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-0b1f9469-9ff4-4891-91f4-868c2fa5b92e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-0b1f9469-9ff4-4891-91f4-868c2fa5b92e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-quobyte-0b1f9469-9ff4-4891-91f4-868c2fa5b92e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-0b1f9469-9ff4-4891-91f4-868c2fa5b92e" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7083d5d-57a6-4a10-a19b-196aac6d1b39]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414" returned: 0 in 0.401s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 Nov 03 07:50:43 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e Nov 03 07:50:43 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0b1f9469-9ff4-4891-91f4-868c2fa5b92e" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-0b1f9469-9ff4-4891-91f4-868c2fa5b92e" released by "delete_volume" :: held 0.727s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created reservations ['cb92a19c-9430-499b-9c62-98c8b7a405bd', '81dfc9fb-fd1e-4616-8c5a-401bd2057d78', 'af0775b8-b7ae-41d8-affc-fbd5539c428c', 'e63fe543-4574-4597-9546-4f0fe93c221e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:44 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-5fa93067-bc4b-434c-94cd-c199dcde38eb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-5fa93067-bc4b-434c-94cd-c199dcde38eb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-quobyte-5fa93067-bc4b-434c-94cd-c199dcde38eb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-5fa93067-bc4b-434c-94cd-c199dcde38eb" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[515a8db9-0097-4597-bfbb-bf10ee5147c5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.481s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Deleted volume successfully. Nov 03 07:50:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5541b9a-e0fd-4eeb-b273-57f1f8d14f50 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-0b1f9469-9ff4-4891-91f4-868c2fa5b92e-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb Nov 03 07:50:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb" returned: 0 in 0.739s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb Nov 03 07:50:45 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5fa93067-bc4b-434c-94cd-c199dcde38eb" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-5fa93067-bc4b-434c-94cd-c199dcde38eb" released by "delete_volume" :: held 1.259s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created reservations ['5f04f30d-e34b-48ff-b89b-99e939fb251a', '7b8019ad-5d3c-4b33-868e-02e64065b878', 'e40697ea-8656-4350-8793-8facc1754665', '8bda74e3-2491-4a59-a21e-19b0eb794cf4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:46 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:46 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:46 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Deleted volume successfully. Nov 03 07:50:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-75538dc6-bf00-4130-9923-a078de9b414d tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-5fa93067-bc4b-434c-94cd-c199dcde38eb-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-f7edeaab-73bf-4b49-92aa-59be29fc0d0f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-f7edeaab-73bf-4b49-92aa-59be29fc0d0f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-quobyte-f7edeaab-73bf-4b49-92aa-59be29fc0d0f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-f7edeaab-73bf-4b49-92aa-59be29fc0d0f" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c05880-3132-4c64-b1aa-92898d0228e3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:47 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f Nov 03 07:50:47 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:47 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f" returned: 0 in 0.520s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:47 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f Nov 03 07:50:47 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:48 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-f7edeaab-73bf-4b49-92aa-59be29fc0d0f" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-f7edeaab-73bf-4b49-92aa-59be29fc0d0f" released by "delete_volume" :: held 1.000s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created reservations ['f8fd1801-2d7b-4a7b-aeca-379058771edd', 'f7a5fe38-429d-4387-80f7-d4711636b068', '02f06449-d9bf-4524-bb2e-bf55e77ac251', 'b581c4ec-8fbf-4fed-b315-bbbd6b68b4bb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:48 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:48 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:48 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.290s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Deleted volume successfully. Nov 03 07:50:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fd068da-0c4c-45e0-bd50-9b12d42bc677 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-f7edeaab-73bf-4b49-92aa-59be29fc0d0f-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-d5dee082-1222-4ae8-a44b-66e096828199-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-d5dee082-1222-4ae8-a44b-66e096828199-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-quobyte-d5dee082-1222-4ae8-a44b-66e096828199" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-d5dee082-1222-4ae8-a44b-66e096828199" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6053ceb6-3308-4726-bfb8-1269a99266df]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:49 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 Nov 03 07:50:49 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199" returned: 0 in 0.504s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:50 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199 Nov 03 07:50:50 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-d5dee082-1222-4ae8-a44b-66e096828199" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-d5dee082-1222-4ae8-a44b-66e096828199" released by "delete_volume" :: held 0.970s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:50 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5" returned: 0 in 6.850s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:50:50 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Converted 1024.00 MB image at 149.46 MB/s Nov 03 07:50:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 is being set with open permissions: ugo+rw Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:50 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 Nov 03 07:50:50 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created reservations ['05869238-7dd1-4a03-948c-91abeee45c63', '49cd72f6-fde1-4884-b856-ebb69fe43cb4', 'b6169222-1a5c-441a-ab87-014826c42d40', '9bade73b-948d-4867-adc8-53e5346a040c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:50 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:50 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-827c5978-9ecf-4006-9c7d-24ee510918b5" released by "_copy_volume_from_snapshot" :: held 7.929s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-461c564b-46da-4092-825e-600c0d6a7d2e-827c5978-9ecf-4006-9c7d-24ee510918b5" released by "_create_volume_from_snapshot" :: held 8.005s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.038s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.059s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b4ca0ecaee4721bec8344a3fe342b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='d2595878ac614e3785d1605b01d75ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3a671f2-f772-4cf0-9f24-1409dfaf152d),volume_type_id=a3a671f2-f772-4cf0-9f24-1409dfaf152d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Creating volume 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:50 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e 1073741824 Nov 03 07:50:50 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3419bbf4-7522-4859-b334-617ac55bd238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827c5978-9ecf-4006-9c7d-24ee510918b5', 'volume_size': 1, 'snapshot_id': '461c564b-46da-4092-825e-600c0d6a7d2e'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654ba368-d3f0-4106-b0dc-21c9192c3c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:50 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Volume volume-827c5978-9ecf-4006-9c7d-24ee510918b5 (827c5978-9ecf-4006-9c7d-24ee510918b5): created successfully Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654ba368-d3f0-4106-b0dc-21c9192c3c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Flow 'volume_create_manager' (bf502922-2c34-4b48-a147-0761955ce2d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Deleted volume successfully. Nov 03 07:50:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0481b829-4219-4e1a-9786-79e4163791ca tempest-VolumeDependencyTests-2013743992 None] Created volume successfully. Nov 03 07:50:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-764d31a4-2802-4bd1-9d2f-25294acf71dd tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-d5dee082-1222-4ae8-a44b-66e096828199-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:51 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e 1073741824" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:51 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e Nov 03 07:50:51 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:51 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.381s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889088308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526ded2e-1f32-46ce-937c-7eebffdaec33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:41Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating volume 526ded2e-1f32-46ce-937c-7eebffdaec33 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:51 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 1073741824 Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Attempting download of 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'metadata': {}}])) to volume 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:50:51 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-461c564b-46da-4092-825e-600c0d6a7d2e-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-461c564b-46da-4092-825e-600c0d6a7d2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-quobyte-0247b039-21cd-40d3-af51-d80b31320414" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4793cc4b-e0ae-4814-a5d9-27371eb73fb3]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-0247b039-21cd-40d3-af51-d80b31320414" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-quobyte-461c564b-46da-4092-825e-600c0d6a7d2e" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-c9636b80-53d4-4a9c-9088-5def309433b1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-461c564b-46da-4092-825e-600c0d6a7d2e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Deleting offline snapshot 461c564b-46da-4092-825e-600c0d6a7d2e of volume 0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] snapshot_file for this snap is: volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-c9636b80-53d4-4a9c-9088-5def309433b1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f95a5-6129-4e87-89b8-fafe9ec330ad]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:51 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n Nov 03 07:50:51 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-quobyte-c9636b80-53d4-4a9c-9088-5def309433b1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-c9636b80-53d4-4a9c-9088-5def309433b1" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215b0e2-c597-457a-a2fe-c4ac95a14c66]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:51 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e Nov 03 07:50:51 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 Nov 03 07:50:52 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 1073741824" returned: 0 in 0.562s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 Nov 03 07:50:52 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n Nov 03 07:50:52 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0247b039-21cd-40d3-af51-d80b31320414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aefaaff-a06b-45f8-99b3-2d943253b1e4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1 Nov 03 07:50:52 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 Nov 03 07:50:52 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.077s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533235478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fff704-5244-4d4c-a321-fc6d251f634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:41Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating volume e0fff704-5244-4d4c-a321-fc6d251f634a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n" returned: 1 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_a2bekm_n' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e5095-b3b5-489d-ae8c-bf0c717336d4]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a 1073741824 Nov 03 07:50:52 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2abf98-cd7b-4e19-a327-8ac538cc3ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526ded2e-1f32-46ce-937c-7eebffdaec33', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9172059-47c6-4e63-9345-257103e5b728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume volume-526ded2e-1f32-46ce-937c-7eebffdaec33 (526ded2e-1f32-46ce-937c-7eebffdaec33): created successfully Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9172059-47c6-4e63-9345-257103e5b728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (08f45297-b905-4333-b5ed-1adc71b0a142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4dc249e1-effd-4bf0-944b-3f449a3c0f56 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created volume successfully. Nov 03 07:50:52 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c9636b80-53d4-4a9c-9088-5def309433b1" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-c9636b80-53d4-4a9c-9088-5def309433b1" released by "delete_volume" :: held 0.853s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:52 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD Nov 03 07:50:52 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created reservations ['736b8404-7238-4551-acfc-4fa64460c3e4', '73cb9c28-953f-4245-bbc7-a412b03283d9', 'de238b7e-5f9b-4e14-a6f0-f646a688f868', '2717af20-08c4-4da0-b693-b38873143468'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:52 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-41ff703f-212e-45f8-9786-e56f1ead1942-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-41ff703f-212e-45f8-9786-e56f1ead1942-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "cinder-quobyte-41ff703f-212e-45f8-9786-e56f1ead1942" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414" returned: 0 in 0.867s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-41ff703f-212e-45f8-9786-e56f1ead1942" acquired by "delete_volume" :: waited 0.058s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:53 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e Nov 03 07:50:53 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b60a1-24e3-438c-bc90-72e66467d84e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a 1073741824" returned: 0 in 0.727s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Deleted volume successfully. Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0db9ddc3-6c6d-42ae-b0c5-5bc299d0de84 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-c9636b80-53d4-4a9c-9088-5def309433b1-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:53 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD Nov 03 07:50:53 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a Nov 03 07:50:53 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 Nov 03 07:50:53 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e" returned: 0 in 0.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.846s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467981681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8509dd4-603e-4d61-bb2f-c8320a28bdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:42Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating volume a8509dd4-603e-4d61-bb2f-c8320a28bdf0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e Nov 03 07:50:53 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 1073741824 Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba9d9a0-c02d-4abe-b9c0-81d189fa404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fff704-5244-4d4c-a321-fc6d251f634a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c99b6-3fd7-4ff1-be45-1ca2ec607489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD" returned: 1 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942" returned: 0 in 0.608s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e Nov 03 07:50:53 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume volume-e0fff704-5244-4d4c-a321-fc6d251f634a (e0fff704-5244-4d4c-a321-fc6d251f634a): created successfully Nov 03 07:50:53 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942 Nov 03 07:50:53 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c99b6-3fd7-4ff1-be45-1ca2ec607489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (ccd9f9de-661a-4f60-97d2-ecab22b3b8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-59e02984-d8d2-46e2-83dc-4b0f71a49fca tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created volume successfully. Nov 03 07:50:53 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414.461c564b-46da-4092-825e-600c0d6a7d2e" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-461c564b-46da-4092-825e-600c0d6a7d2e" released by "_delete_snapshot" :: held 2.346s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-0247b039-21cd-40d3-af51-d80b31320414" released by "delete_snapshot" :: held 2.387s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Created reservations ['4121c131-ebea-4892-b1c0-7d6666b5d9db', 'f59c6f70-0a64-4890-b512-264e67eda46f', 'a718ec97-662f-4580-bacf-0dadab68cb37', '3d89df4b-6f96-4be4-b6c4-553fc98b6878'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:54 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ff703f-212e-45f8-9786-e56f1ead1942" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-quobyte-41ff703f-212e-45f8-9786-e56f1ead1942" released by "delete_volume" :: held 1.016s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Delete snapshot completed successfully. Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9cd7c9c-877d-4724-9aad-5f1bf9d71df1 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-461c564b-46da-4092-825e-600c0d6a7d2e-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Created reservations ['cf8c748d-1ef1-4413-9e5a-271339a0e8ee', 'b6321c97-3e54-4b9b-afbe-8e0eaf1379b4', 'f161bcb4-47df-4095-a099-0ac88183a4db', 'e7f52629-4e82-452a-ba27-f1b78296b7cb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:54 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 1073741824" returned: 0 in 0.599s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 Nov 03 07:50:54 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:54 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" returned: 0 in 0.655s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29bc5775-a741-4e5f-9b93-cb0c1d6327d8_obc09x1udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:50:54 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:54 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e 1G Nov 03 07:50:54 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.317s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:54 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412441886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f0942d-e082-4b62-99f8-11a4e27d8a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:42Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating volume 93f0942d-e082-4b62-99f8-11a4e27d8a63 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Deleted volume successfully. Nov 03 07:50:54 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 1073741824 Nov 03 07:50:54 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42983b3-73cd-4d28-a17b-272ca0c352f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c6beb3-d31d-422c-9910-68fb734c91ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 (a8509dd4-603e-4d61-bb2f-c8320a28bdf0): created successfully Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c6beb3-d31d-422c-9910-68fb734c91ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (e19de3ae-dbcf-41ce-b39a-241a60c6e13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4b2ac93c-46ec-40d8-a015-16b3871cd300 tempest-CreateVolumesFromSourceVolumeTest-886817301 None] Lock "cinder-41ff703f-212e-45f8-9786-e56f1ead1942-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f76641ee-47f6-4344-bebe-7c978626473d tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created volume successfully. Nov 03 07:50:54 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e 1G" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Downloaded image 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'metadata': {}}])) to volume 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Temporary image 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 for user d2595878ac614e3785d1605b01d75ec8 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Marking volume 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Copying metadata from image 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 to 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Creating volume glance metadata for volume 3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e backed by image 29bc5775-a741-4e5f-9b93-cb0c1d6327d8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5fa3493c1fd50bf3385bd5b06c51c394', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-0247b039-21cd-40d3-af51-d80b31320414-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-0247b039-21cd-40d3-af51-d80b31320414-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-quobyte-0247b039-21cd-40d3-af51-d80b31320414" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-0247b039-21cd-40d3-af51-d80b31320414" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654dfc3-692d-4443-8c1f-a2767a7f1e7b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e70037-4db5-4a44-a0aa-66431c799d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e', 'volume_size': 1, 'image_id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fa3493c1fd50bf3385bd5b06c51c394', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0b4ca0ecaee4721bec8344a3fe342b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '324199b6157596617fc2e5a8d13d78c25e6791b721e64c72fcd3b1ee5835d85e3ea72b77fb52a13d714da5dc8c07e5e876cccd53eca76cb58929b36f3d408061', 'id': '29bc5775-a741-4e5f-9b93-cb0c1d6327d8', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29bc5775-a741-4e5f-9b93-cb0c1d6327d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033c4334-378c-49c0-a7dc-a1424e896c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Volume volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e (3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e): created successfully Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033c4334-378c-49c0-a7dc-a1424e896c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Flow 'volume_create_manager' (0ee9e98c-d275-4e95-9395-4d88d9703759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-81ac7e18-b1dc-4e65-8931-2ccd00f3b505 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Created volume successfully. Nov 03 07:50:55 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 Nov 03 07:50:55 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:55 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 1073741824" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:55 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 Nov 03 07:50:55 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:55 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414" returned: 0 in 0.488s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:55 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414 Nov 03 07:50:55 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:55 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.930s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277852676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79457f0-a5c8-4a51-a2d6-5ec89f2d6040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57953becae7f4ed7a16ea6911f3efcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:43Z,use_quota=True,user_id='b668cced13b3454aa6054500c59864f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Creating volume c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:55 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 1073741824 Nov 03 07:50:55 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed49bc5-08d4-4083-b917-0add3d6bbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f0942d-e082-4b62-99f8-11a4e27d8a63', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d74f387-9c92-441a-8681-f6f5118451ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 (93f0942d-e082-4b62-99f8-11a4e27d8a63): created successfully Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d74f387-9c92-441a-8681-f6f5118451ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (4b3176f6-4f5a-4134-a7d8-bd4eac721b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-14c10dd1-d658-4e6d-baa0-86c5f232b1e4 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created volume successfully. Nov 03 07:50:55 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0247b039-21cd-40d3-af51-d80b31320414" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Acquiring lock "cinder-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-0247b039-21cd-40d3-af51-d80b31320414" released by "delete_volume" :: held 0.867s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "cinder-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Acquiring lock "cinder-quobyte-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Created reservations ['b5753d38-12fa-4367-b350-4a5f62e1f9dc', '187d6213-9a38-4f28-a6ab-f84157deb9fa', 'cd0909eb-df31-4a7a-8ac3-dfc5216908de', '3f418002-011d-4232-8876-43c920ac46ea'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "cinder-quobyte-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db672ba-8d2e-4e4a-bcf7-4fca0dbec385]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:56 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:56 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:56 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e Nov 03 07:50:56 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:56 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 1073741824" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:56 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 Nov 03 07:50:56 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:56 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Deleted volume successfully. Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4277fe01-1153-4b2a-bd47-bed48cb79e0a tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-0247b039-21cd-40d3-af51-d80b31320414-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:56 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" returned: 0 in 0.567s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:56 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e Nov 03 07:50:56 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:56 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d895a609-634e-4539-a3b6-c2427606cc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85228110-1467-4f97-a6fa-952416543af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Volume volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 (c79457f0-a5c8-4a51-a2d6-5ec89f2d6040): created successfully Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85228110-1467-4f97-a6fa-952416543af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Flow 'volume_create_manager' (e843c3c7-d806-4a06-8d3f-f56c72c22bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ddea2bdd-504c-4829-a7fc-180a43e76da6 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created volume successfully. Nov 03 07:50:56 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "cinder-quobyte-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e" released by "delete_volume" :: held 0.918s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Created reservations ['80cfce21-3d9c-4360-8e0e-d1fd4422e003', 'e26fb514-6901-4d4e-99fc-0cfb1f462fd1', 'a7d80a39-a901-4658-8df6-ec0f66adbd99', 'e32fb1a7-b977-4767-a6e9-83bfba3bb397'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:57 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:57 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-827c5978-9ecf-4006-9c7d-24ee510918b5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-827c5978-9ecf-4006-9c7d-24ee510918b5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "cinder-quobyte-827c5978-9ecf-4006-9c7d-24ee510918b5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-827c5978-9ecf-4006-9c7d-24ee510918b5" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:57 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da47abd-3e72-405d-a4e9-a925286f6bc4]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Deleted volume successfully. Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56d9cea2-bf74-4dfb-9605-f2379b440471 tempest-VolumeAndVolumeTypeFromImageTest-1164146816 None] Lock "cinder-3e1ce5eb-fc3f-40b2-b0a3-d2b5d4a9bc4e-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97ad4d-220e-4aab-8b01-447f0dcf11d1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:57 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 Nov 03 07:50:57 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:57 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 Nov 03 07:50:57 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:57 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5" returned: 0 in 0.500s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5 Nov 03 07:50:58 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040 Nov 03 07:50:58 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-827c5978-9ecf-4006-9c7d-24ee510918b5" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-quobyte-827c5978-9ecf-4006-9c7d-24ee510918b5" released by "delete_volume" :: held 0.942s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:58 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040" released by "delete_volume" :: held 0.816s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Created reservations ['d80b4a79-79f3-471c-ba18-c6836d5ca9a4', '79830370-7721-4c07-a791-55871830562b', '648a5608-95d2-4e38-849c-463c2da0223a', '255af317-b28e-466a-ae3e-4008bbd9d30b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['8903a8d2-56b1-4a14-bb8b-871cd51da447', '80df212c-e657-4992-b5f2-206ccb189d21', '03a3e659-4a55-498f-bac4-0b2bff6a528b', '36aab149-a443-4014-951d-c464e15e87b1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:58 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:58 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-93f0942d-e082-4b62-99f8-11a4e27d8a63-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-93f0942d-e082-4b62-99f8-11a4e27d8a63-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-93f0942d-e082-4b62-99f8-11a4e27d8a63" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-93f0942d-e082-4b62-99f8-11a4e27d8a63" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c744c84-39e5-4327-832b-1751f68c69d1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:59 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Deleted volume successfully. Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e345c5dc-7993-4812-ac66-42233dfa8b43 tempest-VolumeDependencyTests-2013743992 None] Lock "cinder-827c5978-9ecf-4006-9c7d-24ee510918b5-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:59 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 Nov 03 07:50:59 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:59 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleted volume successfully. Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fb475468-74ca-4429-8452-e4f5879c3318 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-c79457f0-a5c8-4a51-a2d6-5ec89f2d6040-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:59 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63" returned: 0 in 0.501s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:59 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63 Nov 03 07:50:59 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:59 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-93f0942d-e082-4b62-99f8-11a4e27d8a63" returned: 0 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-93f0942d-e082-4b62-99f8-11a4e27d8a63" released by "delete_volume" :: held 0.895s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['6d00996e-dd5b-479e-9dc4-eddd4700b5b9', 'd8713d9c-b014-4600-9ea4-557b420909bb', '0f165422-cb3b-47c8-ac94-396130ad216e', '84efebd9-1fc4-4b9c-bace-4cc089be0526'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:59 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:50:59 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-a8509dd4-603e-4d61-bb2f-c8320a28bdf0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-a8509dd4-603e-4d61-bb2f-c8320a28bdf0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-a8509dd4-603e-4d61-bb2f-c8320a28bdf0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-a8509dd4-603e-4d61-bb2f-c8320a28bdf0" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47539bf-c8fc-4773-b47a-f6907a649077]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:00 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleted volume successfully. Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4b7da5d-7030-4b8c-99ed-fb06887aac8b tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-93f0942d-e082-4b62-99f8-11a4e27d8a63-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:00 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 Nov 03 07:51:00 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:00 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:00 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0 Nov 03 07:51:00 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a8509dd4-603e-4d61-bb2f-c8320a28bdf0" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-a8509dd4-603e-4d61-bb2f-c8320a28bdf0" released by "delete_volume" :: held 0.869s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['2434b81b-f5fa-4d78-b626-4ab046e041ee', '91a800df-cd89-4cb2-b6b1-bd4edc37c09b', 'cf9c07f5-f4aa-499f-95be-0df1d4374afc', '73f63639-0fd1-45ed-8794-f77d682603d3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:01 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-e0fff704-5244-4d4c-a321-fc6d251f634a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-e0fff704-5244-4d4c-a321-fc6d251f634a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-e0fff704-5244-4d4c-a321-fc6d251f634a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-e0fff704-5244-4d4c-a321-fc6d251f634a" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a33796-7b58-401c-80ed-d667f3fa859c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a Nov 03 07:51:01 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.477s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleted volume successfully. Nov 03 07:51:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2df51c39-ddc0-4a34-b15d-bba79594f919 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-a8509dd4-603e-4d61-bb2f-c8320a28bdf0-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:02 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a" returned: 0 in 0.564s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a Nov 03 07:51:02 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e0fff704-5244-4d4c-a321-fc6d251f634a" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-e0fff704-5244-4d4c-a321-fc6d251f634a" released by "delete_volume" :: held 0.936s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['64deeaaa-c3b2-42b2-a778-8a1e7931fbf9', '8a47ba6c-60de-4f1a-9a76-6f41cf9646f4', '847273ff-7e0f-45f8-b035-9fb42fb61bf4', '04139f83-a976-4469-a637-03b0b574c517'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:02 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleted volume successfully. Nov 03 07:51:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b1f120c3-5ed9-4095-8089-05353af6f8fa tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-e0fff704-5244-4d4c-a321-fc6d251f634a-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-526ded2e-1f32-46ce-937c-7eebffdaec33-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-526ded2e-1f32-46ce-937c-7eebffdaec33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-526ded2e-1f32-46ce-937c-7eebffdaec33" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-526ded2e-1f32-46ce-937c-7eebffdaec33" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[151978b2-02a0-46b2-9929-d5c610cc7e93]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 Nov 03 07:51:04 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33 Nov 03 07:51:04 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (e6a28a9d-5b1b-4809-81cd-712700abecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd17251-f409-47f1-a20c-b330cf1b4c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd17251-f409-47f1-a20c-b330cf1b4c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1736944056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377ee9e3-2b76-4f1b-a397-e7fac7161003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:05Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71247d66-4c02-4a25-bde7-bba719cd035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71247d66-4c02-4a25-bde7-bba719cd035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd214b0c-46fb-45bd-b1e3-64cd64eeecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd214b0c-46fb-45bd-b1e3-64cd64eeecf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377ee9e3-2b76-4f1b-a397-e7fac7161003', 'volume_name': 'volume-377ee9e3-2b76-4f1b-a397-e7fac7161003', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80b891-3cb8-4cc4-8e13-dbcf9512992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f80b891-3cb8-4cc4-8e13-dbcf9512992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ca60b1-6492-461b-8479-c33a9156947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Volume 377ee9e3-2b76-4f1b-a397-e7fac7161003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377ee9e3-2b76-4f1b-a397-e7fac7161003', 'volume_size': 1} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1736944056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377ee9e3-2b76-4f1b-a397-e7fac7161003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:05Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Creating volume 377ee9e3-2b76-4f1b-a397-e7fac7161003 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 1073741824 Nov 03 07:51:04 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-526ded2e-1f32-46ce-937c-7eebffdaec33" returned: 0 in 0.561s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-526ded2e-1f32-46ce-937c-7eebffdaec33" released by "delete_volume" :: held 1.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['c5097c87-f3c8-4d83-b809-1394b0d96cbc', 'f199d967-6856-4d9d-9159-59da5574ba3f', 'ea4192ce-40f0-482e-b7e4-6b5af470a1c4', '420c17e7-16a6-4151-94f8-5135a70395d2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (321534cd-5809-4ccf-8627-f8eb79b4cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e03b7df-629c-48ad-a152-49bcae0bfab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e03b7df-629c-48ad-a152-49bcae0bfab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17453433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:05Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa819006-4e49-4419-be98-037aa0cc0853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa819006-4e49-4419-be98-037aa0cc0853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b54dab6-1efd-4101-939f-01e9337d38f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b54dab6-1efd-4101-939f-01e9337d38f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4', 'volume_name': 'volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69676bdc-53ec-43df-9aef-84503e25219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69676bdc-53ec-43df-9aef-84503e25219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9bfa24-03b0-4687-9967-1657dfbf489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Volume 4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4', 'volume_size': 1} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:05 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:05 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:05 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 1073741824" returned: 0 in 0.804s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:05 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 Nov 03 07:51:05 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:05 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleted volume successfully. Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7a2d1968-5fc1-42d5-ab3a-d8e222eb86f9 tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-526ded2e-1f32-46ce-937c-7eebffdaec33-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (cb1524ea-beb7-41d9-9603-93d64896210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bbdfa1-81b8-49fb-86ae-74549d52191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bbdfa1-81b8-49fb-86ae-74549d52191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1933880692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf72662-64c1-430f-8518-762b23ef1d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:06Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e27972-61db-4305-b4ce-07f4d2f81201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e27972-61db-4305-b4ce-07f4d2f81201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66f0fdf-453e-4511-8151-72cbebba732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66f0fdf-453e-4511-8151-72cbebba732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf72662-64c1-430f-8518-762b23ef1d06', 'volume_name': 'volume-9bf72662-64c1-430f-8518-762b23ef1d06', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e2c0f4-ea70-4455-abfe-a437c262d580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e2c0f4-ea70-4455-abfe-a437c262d580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f710909-b8ab-4420-ba7b-d4bd7e320bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Volume 9bf72662-64c1-430f-8518-762b23ef1d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf72662-64c1-430f-8518-762b23ef1d06', 'volume_size': 1} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:06 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003" returned: 0 in 0.496s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17453433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:05Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Creating volume 4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-41562145-eee3-48fb-8779-24ba99e81d13-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ca60b1-6492-461b-8479-c33a9156947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377ee9e3-2b76-4f1b-a397-e7fac7161003', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 1073741824 Nov 03 07:51:06 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d14afed-0580-4913-8118-9aaea09b1352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-41562145-eee3-48fb-8779-24ba99e81d13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-9fd7b156-e02f-4256-8d86-2422edf35d5a" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Volume volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 (377ee9e3-2b76-4f1b-a397-e7fac7161003): created successfully Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d14afed-0580-4913-8118-9aaea09b1352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (e6a28a9d-5b1b-4809-81cd-712700abecca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-9fd7b156-e02f-4256-8d86-2422edf35d5a" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-41562145-eee3-48fb-8779-24ba99e81d13" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-664c43c4-fbbd-4958-bbb0-ef566e7cc963 tempest-CreateVolumesFromImageTest-923873877 None] Created volume successfully. Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-41562145-eee3-48fb-8779-24ba99e81d13" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleting offline snapshot 41562145-eee3-48fb-8779-24ba99e81d13 of volume 9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] snapshot_file for this snap is: volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47616d5-c2c4-4b3c-a3b2-c9041ce2e7cf]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (8ed50d96-86dc-4cfc-a95f-20daa7534e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdd712b-390d-427b-8e4d-83c2fbb6e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdd712b-390d-427b-8e4d-83c2fbb6e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-916185427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d804826-7e28-4498-b411-13de2c307940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:06Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed685c1f-7993-481d-bd1c-7750352e7c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed685c1f-7993-481d-bd1c-7750352e7c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796bb095-c848-48da-b88c-fa919474c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796bb095-c848-48da-b88c-fa919474c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d804826-7e28-4498-b411-13de2c307940', 'volume_name': 'volume-3d804826-7e28-4498-b411-13de2c307940', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4311a54b-cece-41ef-8515-de31bd603238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4311a54b-cece-41ef-8515-de31bd603238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a967f5-22f1-4fae-be29-ce4c4f53bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Volume 3d804826-7e28-4498-b411-13de2c307940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d804826-7e28-4498-b411-13de2c307940', 'volume_size': 1} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:06 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 Nov 03 07:51:06 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:06 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 1073741824" returned: 0 in 0.693s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:06 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 Nov 03 07:51:06 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13" returned: 0 in 0.639s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fd7b156-e02f-4256-8d86-2422edf35d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2c770-39be-4e9f-8af3-4c8a0b3fbc2c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (daf4fa75-b760-4b3b-899b-5fe666611ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3fd718-cf98-4886-a2bc-519582e3ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3fd718-cf98-4886-a2bc-519582e3ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594645824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ffd5d1-989c-49b1-808b-52f196b82c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:07Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3e0291-d2c0-4144-8ab1-bb1deee479a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3e0291-d2c0-4144-8ab1-bb1deee479a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874f8127-ef44-4286-8d54-f08f08dd1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874f8127-ef44-4286-8d54-f08f08dd1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ffd5d1-989c-49b1-808b-52f196b82c91', 'volume_name': 'volume-41ffd5d1-989c-49b1-808b-52f196b82c91', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b7ded0-5908-4e61-ad86-cbb282419c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b7ded0-5908-4e61-ad86-cbb282419c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db58fd1-fb21-4986-bce4-547a6aec14d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Volume 41ffd5d1-989c-49b1-808b-52f196b82c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ffd5d1-989c-49b1-808b-52f196b82c91', 'volume_size': 1} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:07 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1933880692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf72662-64c1-430f-8518-762b23ef1d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:06Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Creating volume 9bf72662-64c1-430f-8518-762b23ef1d06 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:07 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:07 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a Nov 03 07:51:07 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9bfa24-03b0-4687-9967-1657dfbf489d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 1073741824 Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d25de08-64eb-46ec-b2a2-7a440a60ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Volume volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 (4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4): created successfully Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d25de08-64eb-46ec-b2a2-7a440a60ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (321534cd-5809-4ccf-8627-f8eb79b4cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8bdf1183-91c3-4913-9b2d-8dcaeb135597 tempest-CreateVolumesFromImageTest-923873877 None] Created volume successfully. Nov 03 07:51:07 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a" returned: 0 in 0.585s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:07 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 Nov 03 07:51:07 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Flow 'volume_create_manager' (0b43a960-9650-46e5-8ae2-799f2470ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0e0d26-13fc-4e68-870d-fd079ab74208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 1073741824" returned: 0 in 0.675s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0e0d26-13fc-4e68-870d-fd079ab74208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-59798046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce332c0-10fe-45c7-bd0a-4c8f84c8c29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e510c31ea2254928bc7209db6d916412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:08Z,use_quota=True,user_id='e66b16e432bf4f38a8520db18cfa987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707ed876-edb2-4ff9-8426-5213abd1d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707ed876-edb2-4ff9-8426-5213abd1d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5663d584-45dc-4620-956a-94adbc2d84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5663d584-45dc-4620-956a-94adbc2d84eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce332c0-10fe-45c7-bd0a-4c8f84c8c29e', 'volume_name': 'volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3386f9-9eae-4483-a44c-f10badc61fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3386f9-9eae-4483-a44c-f10badc61fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004f8544-1e45-4fc0-8a55-e3fd1e570af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Volume bce332c0-10fe-45c7-bd0a-4c8f84c8c29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e', 'volume_size': 1} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:08 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 Nov 03 07:51:08 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:08 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13" returned: 0 in 0.491s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:08 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13 Nov 03 07:51:08 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:08 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-916185427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d804826-7e28-4498-b411-13de2c307940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:06Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Creating volume 3d804826-7e28-4498-b411-13de2c307940 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:08 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a.41562145-eee3-48fb-8779-24ba99e81d13" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:08 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 1073741824 Nov 03 07:51:08 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f710909-b8ab-4420-ba7b-d4bd7e320bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf72662-64c1-430f-8518-762b23ef1d06', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7bdac9-e338-489e-887a-2bac959394e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Volume volume-9bf72662-64c1-430f-8518-762b23ef1d06 (9bf72662-64c1-430f-8518-762b23ef1d06): created successfully Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7bdac9-e338-489e-887a-2bac959394e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (cb1524ea-beb7-41d9-9603-93d64896210d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-41562145-eee3-48fb-8779-24ba99e81d13" released by "_delete_snapshot" :: held 2.253s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b4d4382a-68e0-4c6c-bee3-56cdc39ac97c tempest-CreateVolumesFromImageTest-923873877 None] Created volume successfully. Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-9fd7b156-e02f-4256-8d86-2422edf35d5a" released by "delete_snapshot" :: held 2.308s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Flow 'volume_create_manager' (19358927-6e7b-4aad-ba3e-7146127dde23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5492a4-c6db-4c81-a226-77efcd3bd36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5492a4-c6db-4c81-a226-77efcd3bd36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e80c1ecae2d428d8a23bd8190e0d0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:09Z,use_quota=True,user_id='00ee29c367e04408b087dbb8ea4a05d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9551de4-ef0f-4b43-b448-9e36455483e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9551de4-ef0f-4b43-b448-9e36455483e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9dd5f89-0823-45a5-a07d-701e5589bee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['25acb5bf-4725-4d29-8596-46a431731421', '5810faa7-5eb9-471d-b9d9-77bd5a18599c', '5340dd60-b415-4865-b05c-4ce169400a7b', '42c70706-6e16-4049-9105-4438c6a459c6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Delete snapshot completed successfully. Nov 03 07:51:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91926c14-d6ab-43a8-93f3-e6c14120b53e tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-41562145-eee3-48fb-8779-24ba99e81d13-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:09 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 1073741824" returned: 0 in 0.517s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 Nov 03 07:51:09 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9dd5f89-0823-45a5-a07d-701e5589bee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a', 'volume_name': 'volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a', 'volume_size': 1, 'image_id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0db3e3a8-02cf-4d88-8624-99127ebaa002', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2c5e5f95be8ced1338755c6183b4338', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e80c1ecae2d428d8a23bd8190e0d0ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '78e2e9675dd4f6f3fa02d3e6fbeb5b2759f169c94b2b0762f8bc8b7403cb027061e9f49a25668232b6c10dd32ed54bf6cd9f929cb14214957e109abd3a55dbf1', 'id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'created_at': datetime.datetime(2026, 11, 3, 6, 51, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0db3e3a8-02cf-4d88-8624-99127ebaa002/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6dab00-951a-4336-bb67-09dcbb78c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6dab00-951a-4336-bb67-09dcbb78c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de81adb1-82b8-4f4a-9535-5397ad5a62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Volume cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a', 'volume_size': 1, 'image_id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0db3e3a8-02cf-4d88-8624-99127ebaa002', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2c5e5f95be8ced1338755c6183b4338', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e80c1ecae2d428d8a23bd8190e0d0ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '78e2e9675dd4f6f3fa02d3e6fbeb5b2759f169c94b2b0762f8bc8b7403cb027061e9f49a25668232b6c10dd32ed54bf6cd9f929cb14214957e109abd3a55dbf1', 'id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'created_at': datetime.datetime(2026, 11, 3, 6, 51, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0db3e3a8-02cf-4d88-8624-99127ebaa002/file', 'properties': {}}, 'image_service': } Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Trying to clone cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a from image 0db3e3a8-02cf-4d88-8624-99127ebaa002 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0db3e3a8-02cf-4d88-8624-99127ebaa002', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:51:09 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2e8d94-2955-49a1-991f-4d6141f27b3e]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594645824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ffd5d1-989c-49b1-808b-52f196b82c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe87dc0edec42cea4217229d4c4ab5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:07Z,use_quota=True,user_id='a728ed1d4af5484aad2cc4eb9fb2db56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Creating volume 41ffd5d1-989c-49b1-808b-52f196b82c91 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a967f5-22f1-4fae-be29-ce4c4f53bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d804826-7e28-4498-b411-13de2c307940', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6203f16-06ab-4fce-ae91-ce31fbcfd1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 1073741824 Nov 03 07:51:09 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Volume volume-3d804826-7e28-4498-b411-13de2c307940 (3d804826-7e28-4498-b411-13de2c307940): created successfully Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6203f16-06ab-4fce-ae91-ce31fbcfd1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (8ed50d96-86dc-4cfc-a95f-20daa7534e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-025a5b82-4b34-41c9-a1af-20a1ebdf8f0b tempest-CreateVolumesFromImageTest-923873877 None] Created volume successfully. Nov 03 07:51:09 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD Nov 03 07:51:09 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-9fd7b156-e02f-4256-8d86-2422edf35d5a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-9fd7b156-e02f-4256-8d86-2422edf35d5a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "cinder-quobyte-9fd7b156-e02f-4256-8d86-2422edf35d5a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-9fd7b156-e02f-4256-8d86-2422edf35d5a" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e5b3f-9b86-4dbd-9dd1-a4d99eb95d32]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a Nov 03 07:51:09 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD Nov 03 07:51:09 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 1073741824" returned: 0 in 0.599s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 Nov 03 07:51:10 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD" returned: 1 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Temporary image 0db3e3a8-02cf-4d88-8624-99127ebaa002 is fetched for user 00ee29c367e04408b087dbb8ea4a05d6. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:51:10 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a Nov 03 07:51:10 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[500adc55-56e5-4ccc-af4e-c86a0ecf5197]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-59798046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce332c0-10fe-45c7-bd0a-4c8f84c8c29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e510c31ea2254928bc7209db6d916412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:08Z,use_quota=True,user_id='e66b16e432bf4f38a8520db18cfa987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Creating volume bce332c0-10fe-45c7-bd0a-4c8f84c8c29e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db58fd1-fb21-4986-bce4-547a6aec14d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ffd5d1-989c-49b1-808b-52f196b82c91', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab835f15-5a99-4ea1-9dc9-50c784c8824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e 1073741824 Nov 03 07:51:10 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD Nov 03 07:51:10 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Volume volume-41ffd5d1-989c-49b1-808b-52f196b82c91 (41ffd5d1-989c-49b1-808b-52f196b82c91): created successfully Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab835f15-5a99-4ea1-9dc9-50c784c8824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Flow 'volume_create_manager' (daf4fa75-b760-4b3b-899b-5fe666611ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-20514c82-be7d-4b20-95bd-74870203adc8 tempest-CreateVolumesFromImageTest-923873877 None] Created volume successfully. Nov 03 07:51:10 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9fd7b156-e02f-4256-8d86-2422edf35d5a" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-quobyte-9fd7b156-e02f-4256-8d86-2422edf35d5a" released by "delete_volume" :: held 0.822s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Created reservations ['6a918d32-7c1e-470a-a8f5-2d6cd1675734', 'a0918d4c-f8d1-472a-90bb-fbe0b55e533d', '7c493412-1a52-4857-86b6-9796ea31396d', 'cc2d9cdf-477f-4e2e-babc-be08d45c05fd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:10 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD Nov 03 07:51:10 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-41ffd5d1-989c-49b1-808b-52f196b82c91-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-41ffd5d1-989c-49b1-808b-52f196b82c91-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:10 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-quobyte-41ffd5d1-989c-49b1-808b-52f196b82c91" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Deleted volume successfully. Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-41ffd5d1-989c-49b1-808b-52f196b82c91" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:10 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e 1073741824" returned: 0 in 0.673s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fee6a130-d9c9-4092-abb2-0d237694229f tempest-CreateVolumesFromSnapshotTest-1902730014 None] Lock "cinder-9fd7b156-e02f-4256-8d86-2422edf35d5a-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546f0f7-4928-44b0-a45a-76c919acde8a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:11 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e Nov 03 07:51:11 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 Nov 03 07:51:11 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e" returned: 0 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e80c1ecae2d428d8a23bd8190e0d0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:09Z,use_quota=True,user_id='00ee29c367e04408b087dbb8ea4a05d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Creating volume cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004f8544-1e45-4fc0-8a55-e3fd1e570af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:11 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f513bd-871a-49ca-8b82-659a4590f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:11 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a 1073741824 Nov 03 07:51:11 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Volume volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e (bce332c0-10fe-45c7-bd0a-4c8f84c8c29e): created successfully Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f513bd-871a-49ca-8b82-659a4590f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Flow 'volume_create_manager' (0b43a960-9650-46e5-8ae2-799f2470ef49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:11 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91 Nov 03 07:51:11 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5734f095-40e4-4b12-9485-0be353c40ba9 tempest-ProjectReaderTests-1196070831 None] Created volume successfully. Nov 03 07:51:11 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-41ffd5d1-989c-49b1-808b-52f196b82c91" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-41ffd5d1-989c-49b1-808b-52f196b82c91" released by "delete_volume" :: held 0.825s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Created reservations ['fa2b6a97-4ddf-4ca2-abeb-57ba91cb1e9c', 'e4f61f45-0502-46f5-9f78-3e7a9d41b1b1', '432cfef8-acbe-440a-9a38-c667935adec1', '5ead5ced-15f0-40fa-9c96-b0d8ff997796'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:11 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a 1073741824" returned: 0 in 0.597s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a Nov 03 07:51:12 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-3d804826-7e28-4498-b411-13de2c307940-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-3d804826-7e28-4498-b411-13de2c307940-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:12 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Deleted volume successfully. Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-quobyte-3d804826-7e28-4498-b411-13de2c307940" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfe8c1a9-cb79-4628-afd2-57e1b3750d5c tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-41ffd5d1-989c-49b1-808b-52f196b82c91-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-3d804826-7e28-4498-b411-13de2c307940" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcd4d7-793f-44e8-9277-bc97c0ec50be]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Attempting download of 0db3e3a8-02cf-4d88-8624-99127ebaa002 ((None, [{'url': 'file:///opt/stack/data/glance/images/0db3e3a8-02cf-4d88-8624-99127ebaa002', 'metadata': {}}])) to volume cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c6ce59-35f8-4b3d-a9fd-50f4088b45e4]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 Nov 03 07:51:12 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt Nov 03 07:51:12 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "cinder-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "cinder-quobyte-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-quobyte-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb14cc4-511a-4f6b-a26f-420413c1adc2]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940" returned: 0 in 0.570s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt" returned: 0 in 0.456s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940 Nov 03 07:51:12 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e Nov 03 07:51:12 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt Nov 03 07:51:13 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-3d804826-7e28-4498-b411-13de2c307940" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-3d804826-7e28-4498-b411-13de2c307940" released by "delete_volume" :: held 0.899s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Created reservations ['bb39597f-e6e6-418c-b3ff-c3c872f9f534', '4e1b0391-7dfa-416c-9584-33462bba30bb', '2dddc03f-8b3e-4fc6-bab0-206101026fc9', '9a265794-4d6b-441f-b524-45f79f26b32a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:13 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e" returned: 0 in 0.458s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e Nov 03 07:51:13 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt" returned: 1 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0db3e3a8-02cf-4d88-8624-99127ebaa002_miw2aftt' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d6d5e-47e5-47a4-9dab-e5d598237aa1]: (4, 'raw') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:13 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD Nov 03 07:51:13 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-quobyte-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e" released by "delete_volume" :: held 0.791s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Created reservations ['9221aa4f-e613-4790-97e7-5b41ea754f7e', '7364032e-fac6-4895-aad1-a8036b43bd6a', '23367011-0c44-4926-b9d2-572b05344532', '48e7c818-9b57-4c2b-8f0b-0bc75dc8f9e1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:13 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Deleted volume successfully. Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eed0f774-468d-4226-aa17-5cb40b486683 tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-3d804826-7e28-4498-b411-13de2c307940-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:13 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:13 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD Nov 03 07:51:13 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Deleted volume successfully. Nov 03 07:51:14 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] 0db3e3a8-02cf-4d88-8624-99127ebaa002 was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5499823-357f-4fe3-823b-6e9c227fe1c1 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-bce332c0-10fe-45c7-bd0a-4c8f84c8c29e-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:14 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a Nov 03 07:51:14 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-9bf72662-64c1-430f-8518-762b23ef1d06-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-9bf72662-64c1-430f-8518-762b23ef1d06-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-quobyte-9bf72662-64c1-430f-8518-762b23ef1d06" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Flow 'volume_create_manager' (a90741eb-6b78-4c2f-999e-10d13d770ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0a6b34-c65b-43d6-b539-8bd9bccfa946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-9bf72662-64c1-430f-8518-762b23ef1d06" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0a6b34-c65b-43d6-b539-8bd9bccfa946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1463911523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debd1617-29aa-46a1-b688-9c16bba0b94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e510c31ea2254928bc7209db6d916412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:14Z,use_quota=True,user_id='e66b16e432bf4f38a8520db18cfa987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d592e6c-d709-4bbc-b686-ba593627bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d592e6c-d709-4bbc-b686-ba593627bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b9c8d6-8370-4107-8e6e-d1ff57c67280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b9c8d6-8370-4107-8e6e-d1ff57c67280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'debd1617-29aa-46a1-b688-9c16bba0b94d', 'volume_name': 'volume-debd1617-29aa-46a1-b688-9c16bba0b94d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff11b00-018d-474e-b4b5-3c140ae9d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff11b00-018d-474e-b4b5-3c140ae9d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f9b014-deb6-4cea-a9fe-8e36f98ecfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Volume debd1617-29aa-46a1-b688-9c16bba0b94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-debd1617-29aa-46a1-b688-9c16bba0b94d', 'volume_size': 1} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1463911523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debd1617-29aa-46a1-b688-9c16bba0b94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e510c31ea2254928bc7209db6d916412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:14Z,use_quota=True,user_id='e66b16e432bf4f38a8520db18cfa987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Creating volume debd1617-29aa-46a1-b688-9c16bba0b94d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d88d5ad-653f-4a9d-92dc-13d4235019da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d 1073741824 Nov 03 07:51:14 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" returned: 0 in 0.603s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0db3e3a8-02cf-4d88-8624-99127ebaa002_xoog1ou2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:51:14 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:51:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a 1G Nov 03 07:51:14 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 Nov 03 07:51:14 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a 1G" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Downloaded image 0db3e3a8-02cf-4d88-8624-99127ebaa002 ((None, [{'url': 'file:///opt/stack/data/glance/images/0db3e3a8-02cf-4d88-8624-99127ebaa002', 'metadata': {}}])) to volume cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Temporary image 0db3e3a8-02cf-4d88-8624-99127ebaa002 for user 00ee29c367e04408b087dbb8ea4a05d6 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Marking volume cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:51:15 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Copying metadata from image 0db3e3a8-02cf-4d88-8624-99127ebaa002 to cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Creating volume glance metadata for volume cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a backed by image 0db3e3a8-02cf-4d88-8624-99127ebaa002 with: {'image_id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a2c5e5f95be8ced1338755c6183b4338', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:51:15 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06 Nov 03 07:51:15 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d 1073741824" returned: 0 in 0.550s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de81adb1-82b8-4f4a-9535-5397ad5a62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a', 'volume_size': 1, 'image_id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0db3e3a8-02cf-4d88-8624-99127ebaa002', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2c5e5f95be8ced1338755c6183b4338', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e80c1ecae2d428d8a23bd8190e0d0ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '78e2e9675dd4f6f3fa02d3e6fbeb5b2759f169c94b2b0762f8bc8b7403cb027061e9f49a25668232b6c10dd32ed54bf6cd9f929cb14214957e109abd3a55dbf1', 'id': '0db3e3a8-02cf-4d88-8624-99127ebaa002', 'created_at': datetime.datetime(2026, 11, 3, 6, 51, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 51, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0db3e3a8-02cf-4d88-8624-99127ebaa002/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc8374f-6ae7-4026-8678-6d2fefbab314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Volume volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a (cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a): created successfully Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc8374f-6ae7-4026-8678-6d2fefbab314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Flow 'volume_create_manager' (19358927-6e7b-4aad-ba3e-7146127dde23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a523571b-dc9d-45d1-bc12-5de909935f40 tempest-VolumeImageDependencyTests-61259229 None] Created volume successfully. Nov 03 07:51:15 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d Nov 03 07:51:15 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-9bf72662-64c1-430f-8518-762b23ef1d06" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-9bf72662-64c1-430f-8518-762b23ef1d06" released by "delete_volume" :: held 0.868s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Created reservations ['2d3c69fb-cc59-4d3c-a301-276fa00c7d37', '5d9cda97-a1ce-4938-b6e4-c9ff1c98a926', '8bcf2ae4-164e-48db-a7b7-36662a2afa59', '7e5b4ded-894d-418e-9b0c-ef7fd38f4701'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d" returned: 0 in 0.305s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:15 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:15 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f9b014-deb6-4cea-a9fe-8e36f98ecfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debd1617-29aa-46a1-b688-9c16bba0b94d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90df4448-bc19-4863-8d77-1e517b97e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Volume volume-debd1617-29aa-46a1-b688-9c16bba0b94d (debd1617-29aa-46a1-b688-9c16bba0b94d): created successfully Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90df4448-bc19-4863-8d77-1e517b97e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Flow 'volume_create_manager' (a90741eb-6b78-4c2f-999e-10d13d770ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d6252452-2b1e-4b9f-b36a-684c0fa38e6c tempest-ProjectReaderTests-1196070831 None] Created volume successfully. Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-quobyte-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf027e-21d1-48bd-9c18-d3051f476667]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 Nov 03 07:51:15 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Deleted volume successfully. Nov 03 07:51:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5058721f-6682-4c53-bb5c-19322eff8afe tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-9bf72662-64c1-430f-8518-762b23ef1d06-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:16 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4 Nov 03 07:51:16 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Acquiring lock "cinder-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Lock "cinder-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Acquiring lock "cinder-quobyte-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Lock "cinder-quobyte-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccd9c0-4785-47e9-bb9e-de339c57e93e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a Nov 03 07:51:16 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4" released by "delete_volume" :: held 0.818s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "cinder-debd1617-29aa-46a1-b688-9c16bba0b94d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Created reservations ['a1796b39-dc32-41be-9eaa-89cfdb68369e', '13576aeb-4c09-494e-84c8-ddf63d4b0777', '0e4c9777-eae2-4f23-94d9-3ac68ce123f3', '358aad13-6970-4283-b597-e78bad869d16'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-debd1617-29aa-46a1-b688-9c16bba0b94d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "cinder-quobyte-debd1617-29aa-46a1-b688-9c16bba0b94d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-quobyte-debd1617-29aa-46a1-b688-9c16bba0b94d" acquired by "delete_volume" :: waited 0.062s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:16 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:16 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d6191-4989-4a46-a9bd-e035f4670124]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a Nov 03 07:51:16 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-377ee9e3-2b76-4f1b-a397-e7fac7161003-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-377ee9e3-2b76-4f1b-a397-e7fac7161003-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:16 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d Nov 03 07:51:16 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "cinder-quobyte-377ee9e3-2b76-4f1b-a397-e7fac7161003" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-377ee9e3-2b76-4f1b-a397-e7fac7161003" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af91ae-d5d3-4cbd-9b49-072efedd6a2e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Deleted volume successfully. Nov 03 07:51:17 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Lock "cinder-quobyte-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a" released by "delete_volume" :: held 0.918s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ddc8c9f-50a7-4fa8-ba3a-1aa606d20a5b tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-4d7ec2bf-1ef4-4daf-9787-f2380a6fdfb4-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 Nov 03 07:51:17 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Created reservations ['3ea6b891-49e2-4624-b5d5-3eb8d37d9bb9', '4d242062-4385-46ee-99a1-f0a27a5fef00', 'bf3fd8cd-3a6a-4564-911e-fa273adaf661', '0b7540e8-5c72-4411-8d3c-d1906d472c0c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:17 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d" returned: 0 in 0.547s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d Nov 03 07:51:17 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:17 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-debd1617-29aa-46a1-b688-9c16bba0b94d" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-quobyte-debd1617-29aa-46a1-b688-9c16bba0b94d" released by "delete_volume" :: held 0.969s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003" returned: 0 in 0.673s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003 Nov 03 07:51:17 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Created reservations ['3f263434-897f-424e-a066-4aeaf1fe0b86', '3320ee5f-0379-4c6e-ba18-f660843ab144', '4500154c-3bb5-4ca9-8147-7d71e0f5473c', 'ab5e76ec-2e3c-4875-863a-4da420161767'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:17 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Deleted volume successfully. Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-435f0f46-002c-4a41-aa74-4410af8627e3 tempest-VolumeImageDependencyTests-61259229 None] Lock "cinder-cdfaf1a7-fe37-4bd7-aebd-a3896fb2120a-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:18 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-377ee9e3-2b76-4f1b-a397-e7fac7161003" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-quobyte-377ee9e3-2b76-4f1b-a397-e7fac7161003" released by "delete_volume" :: held 1.073s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Created reservations ['529b4626-e187-4d3a-8cd1-0578a3d6a455', 'ea2ef119-beff-468c-86ca-82966ae5beab', '7c2fefac-d571-4ea0-aae2-293800dbda16', '3f2e8cad-e35b-4e7d-8c3e-56766e0fe7c4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.333s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Deleted volume successfully. Nov 03 07:51:18 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:18 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03e18970-abcb-4f1e-8b3e-152252f25490 tempest-ProjectReaderTests-1196070831 None] Lock "cinder-debd1617-29aa-46a1-b688-9c16bba0b94d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:18 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Deleted volume successfully. Nov 03 07:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f627c683-0137-4980-bd29-8e0f7c3bdafa tempest-CreateVolumesFromImageTest-923873877 None] Lock "cinder-377ee9e3-2b76-4f1b-a397-e7fac7161003-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Flow 'volume_create_manager' (32b82fb2-0b79-4307-b8b9-aa34e408f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614696e7-0d38-4c22-897f-ca113851ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614696e7-0d38-4c22-897f-ca113851ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b188b3-cf8e-4b07-9681-a641821cc28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ade0a7cd37413a814df46cefcef3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:23Z,use_quota=True,user_id='f86fc800e6574693917dbd8ebeeb043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1e8ceb-87f8-4303-bf3c-ee5565f6aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1e8ceb-87f8-4303-bf3c-ee5565f6aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820efa54-d380-4424-ae4a-ff69566942e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820efa54-d380-4424-ae4a-ff69566942e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b188b3-cf8e-4b07-9681-a641821cc28a', 'volume_name': 'volume-c8b188b3-cf8e-4b07-9681-a641821cc28a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8556544c-19a9-4465-a86c-dd8287b1fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8556544c-19a9-4465-a86c-dd8287b1fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496a5a67-4e9d-4c34-858a-927b032055af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Volume c8b188b3-cf8e-4b07-9681-a641821cc28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b188b3-cf8e-4b07-9681-a641821cc28a', 'volume_size': 1} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b188b3-cf8e-4b07-9681-a641821cc28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ade0a7cd37413a814df46cefcef3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:23Z,use_quota=True,user_id='f86fc800e6574693917dbd8ebeeb043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Creating volume c8b188b3-cf8e-4b07-9681-a641821cc28a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:23 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a 1073741824 Nov 03 07:51:23 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:24 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a 1073741824" returned: 0 in 0.649s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:24 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a Nov 03 07:51:24 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:24 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496a5a67-4e9d-4c34-858a-927b032055af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b188b3-cf8e-4b07-9681-a641821cc28a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512f4cc0-8084-467f-8401-2523bd51a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Volume volume-c8b188b3-cf8e-4b07-9681-a641821cc28a (c8b188b3-cf8e-4b07-9681-a641821cc28a): created successfully Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512f4cc0-8084-467f-8401-2523bd51a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Flow 'volume_create_manager' (32b82fb2-0b79-4307-b8b9-aa34e408f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-efeb882a-73d3-42b4-b4f9-9d529abed04e tempest-CinderUnicodeTest-1599504501 None] Created volume successfully. Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (7b0b1d25-db44-4e40-bd64-7dc6ecf1f238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f67918-cf37-45aa-8301-d315f14c4847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f67918-cf37-45aa-8301-d315f14c4847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143082658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010e6dbc-b6e7-48d2-8b6d-3635194976f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:25Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306bbfd4-87a9-4f1f-9a39-33e0b78015ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306bbfd4-87a9-4f1f-9a39-33e0b78015ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091eee03-4806-4602-991f-23d0add2c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091eee03-4806-4602-991f-23d0add2c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010e6dbc-b6e7-48d2-8b6d-3635194976f2', 'volume_name': 'volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ebe425-426e-450f-b476-02a29d11d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ebe425-426e-450f-b476-02a29d11d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b81b7e0-8e41-49c6-9f71-a9d951526e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Volume 010e6dbc-b6e7-48d2-8b6d-3635194976f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2', 'volume_size': 1} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143082658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010e6dbc-b6e7-48d2-8b6d-3635194976f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:25Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Creating volume 010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:24 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:24 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 1073741824 Nov 03 07:51:24 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:25 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 1073741824" returned: 0 in 0.457s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:25 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 Nov 03 07:51:25 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:25 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b81b7e0-8e41-49c6-9f71-a9d951526e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7ce08c-0447-4b28-9c13-c8f54af4fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Volume volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 (010e6dbc-b6e7-48d2-8b6d-3635194976f2): created successfully Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7ce08c-0447-4b28-9c13-c8f54af4fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (7b0b1d25-db44-4e40-bd64-7dc6ecf1f238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cf96cd37-0ead-4626-ae2a-a7eefbfdc9d4 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (ed5fd8c2-32e2-468d-8de3-3607fe9e06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b8cdc5-9370-41a8-ae95-bb83e768a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b8cdc5-9370-41a8-ae95-bb83e768a842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552819900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe95906-07aa-4d03-9191-48c53c436a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:26Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da96041-979e-4ccf-990a-5afebb45cd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da96041-979e-4ccf-990a-5afebb45cd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3a9715-6729-4374-a527-b9407bfd59fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3a9715-6729-4374-a527-b9407bfd59fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe95906-07aa-4d03-9191-48c53c436a8c', 'volume_name': 'volume-dbe95906-07aa-4d03-9191-48c53c436a8c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f5133a-9d2a-40c0-89fd-c467f4bb30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f5133a-9d2a-40c0-89fd-c467f4bb30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b3bebf-bfc1-4411-a0b3-f4d0c43c0051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Volume dbe95906-07aa-4d03-9191-48c53c436a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe95906-07aa-4d03-9191-48c53c436a8c', 'volume_size': 1} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552819900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe95906-07aa-4d03-9191-48c53c436a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:26Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Creating volume dbe95906-07aa-4d03-9191-48c53c436a8c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:26 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c 1073741824 Nov 03 07:51:26 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:26 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c 1073741824" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Flow 'volume_create_manager' (a600493a-edcd-4c24-9a0c-ea78b1985fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:26 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c Nov 03 07:51:26 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9658a15-8c5c-426b-b7b3-015a4d60cf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9658a15-8c5c-426b-b7b3-015a4d60cf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-448572111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d00c39-0514-4eda-b911-f42156f30938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ade0a7cd37413a814df46cefcef3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:27Z,use_quota=True,user_id='f86fc800e6574693917dbd8ebeeb043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e9e0c5-1209-447d-a18d-c0cbac35ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e9e0c5-1209-447d-a18d-c0cbac35ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a2207a-9d6b-46fa-bb02-f3aade0f3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a2207a-9d6b-46fa-bb02-f3aade0f3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d00c39-0514-4eda-b911-f42156f30938', 'volume_name': 'volume-35d00c39-0514-4eda-b911-f42156f30938', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8031e6-6658-4cb7-9b7e-3eab650ad836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8031e6-6658-4cb7-9b7e-3eab650ad836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b41234-0f9f-4354-b798-9afe1fb8946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Volume 35d00c39-0514-4eda-b911-f42156f30938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d00c39-0514-4eda-b911-f42156f30938', 'volume_size': 1} Nov 03 07:51:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:27 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c" returned: 0 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.502s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b3bebf-bfc1-4411-a0b3-f4d0c43c0051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe95906-07aa-4d03-9191-48c53c436a8c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f055a6f4-a1d9-40cb-acf9-bc4f1e875070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Creating offline snapshot 344d8579-a575-49bc-810e-5c8e34f00547 of volume 010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Volume volume-dbe95906-07aa-4d03-9191-48c53c436a8c (dbe95906-07aa-4d03-9191-48c53c436a8c): created successfully Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f055a6f4-a1d9-40cb-acf9-bc4f1e875070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (ed5fd8c2-32e2-468d-8de3-3607fe9e06b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4992ab20-ca2d-4156-90a1-05aa5b3cb4d1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-287a0d86-3595-4441-bc13-07ca8a5b49de tempest-ProjectReaderTests-461785946 None] Created volume successfully. Nov 03 07:51:27 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 Nov 03 07:51:27 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:27 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:27 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 1G Nov 03 07:51:27 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:27 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 1G" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:27 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 Nov 03 07:51:27 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:28 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 is being set with open permissions: ugo+rw Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-dbe95906-07aa-4d03-9191-48c53c436a8c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:28 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 Nov 03 07:51:28 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Lock "cinder-dbe95906-07aa-4d03-9191-48c53c436a8c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-quobyte-dbe95906-07aa-4d03-9191-48c53c436a8c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-dbe95906-07aa-4d03-9191-48c53c436a8c" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c9877-9a35-4c3d-a0dc-b1b95af1b0da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:28 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c Nov 03 07:51:28 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:28 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=187,cinder:UPDATE=285,cinder:INSERT=74,cinder:DELETE=23 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:28 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info Nov 03 07:51:28 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:28 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c" returned: 0 in 0.445s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:28 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c Nov 03 07:51:28 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:28 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info is being set with open permissions: ugo+rw Nov 03 07:51:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:28 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info Nov 03 07:51:28 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:29 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-dbe95906-07aa-4d03-9191-48c53c436a8c" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-dbe95906-07aa-4d03-9191-48c53c436a8c" released by "delete_volume" :: held 0.778s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=278,cinder:SELECT=221,cinder:DELETE=28,cinder:INSERT=74 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Created reservations ['0ec020c4-6cbf-4b3d-87d3-a2b879350c4c', 'e11db783-4400-4079-809e-4b1c0103bd1d', '270efe18-8996-47e0-9e07-6f6f959f6e0a', '3cd9841a-4a8f-4d27-a296-44d90e57a313'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:29 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.info" returned: 0 in 0.287s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.455s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-448572111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d00c39-0514-4eda-b911-f42156f30938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ade0a7cd37413a814df46cefcef3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:27Z,use_quota=True,user_id='f86fc800e6574693917dbd8ebeeb043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Creating volume 35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:29 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 1073741824 Nov 03 07:51:29 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5155eb1f-f313-4c0b-acfb-a3a89b2439dd tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:29 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:29 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-344d8579-a575-49bc-810e-5c8e34f00547-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Lock "cinder-344d8579-a575-49bc-810e-5c8e34f00547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-010e6dbc-b6e7-48d2-8b6d-3635194976f2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-010e6dbc-b6e7-48d2-8b6d-3635194976f2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-344d8579-a575-49bc-810e-5c8e34f00547" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-344d8579-a575-49bc-810e-5c8e34f00547" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot 344d8579-a575-49bc-810e-5c8e34f00547 of volume 010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cfbe8-878a-4d2c-830e-cac05d67e7eb]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:29 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.431s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Deleted volume successfully. Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27f6afca-4233-41b5-a597-16be7dfae287 tempest-ProjectReaderTests-461785946 None] Lock "cinder-dbe95906-07aa-4d03-9191-48c53c436a8c-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:29 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 1073741824" returned: 0 in 0.717s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 Nov 03 07:51:30 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:30 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 Nov 03 07:51:30 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (c6c1ec37-066c-4433-92e8-2919971b1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31e54b0-69c8-4cbc-b45c-6ca51ed7a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31e54b0-69c8-4cbc-b45c-6ca51ed7a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987267398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd952c3b-4e9b-4334-aa6e-a630f4b0664e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:30Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad6969f-63ef-48fd-977e-31c176096844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad6969f-63ef-48fd-977e-31c176096844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05253e17-c682-4a6b-bd9f-ecc92b108b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05253e17-c682-4a6b-bd9f-ecc92b108b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd952c3b-4e9b-4334-aa6e-a630f4b0664e', 'volume_name': 'volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609f3320-bd6c-4893-bf8a-e6c3f1add567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609f3320-bd6c-4893-bf8a-e6c3f1add567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8b8022-9fa0-4f64-8aaa-f5d1009b5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Volume cd952c3b-4e9b-4334-aa6e-a630f4b0664e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e', 'volume_size': 1} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:30 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:30 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987267398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd952c3b-4e9b-4334-aa6e-a630f4b0664e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:30Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Creating volume cd952c3b-4e9b-4334-aa6e-a630f4b0664e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547" returned: 0 in 0.605s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:30 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e 1073741824 Nov 03 07:51:30 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b41234-0f9f-4354-b798-9afe1fb8946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d00c39-0514-4eda-b911-f42156f30938', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7637de0a-c8f8-4d6f-a154-f4122607fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c61c759-c9b7-4ea0-beb1-37e43162ee78]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Volume volume-35d00c39-0514-4eda-b911-f42156f30938 (35d00c39-0514-4eda-b911-f42156f30938): created successfully Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7637de0a-c8f8-4d6f-a154-f4122607fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Flow 'volume_create_manager' (a600493a-edcd-4c24-9a0c-ea78b1985fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b9df98e5-67e5-4963-b277-8bd1b990be53 tempest-CinderUnicodeTest-1599504501 None] Created volume successfully. Nov 03 07:51:30 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 Nov 03 07:51:30 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2" returned: 0 in 0.466s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:30 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e 1073741824" returned: 0 in 0.552s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 Nov 03 07:51:30 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:31 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e Nov 03 07:51:31 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:31 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8b8022-9fa0-4f64-8aaa-f5d1009b5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8f4b8e-6138-4114-afd0-206a0ab21e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:31 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Creating offline snapshot 4aacbd96-0a19-47c4-ae35-6e980eaebea5 of volume 35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Volume volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e (cd952c3b-4e9b-4334-aa6e-a630f4b0664e): created successfully Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8f4b8e-6138-4114-afd0-206a0ab21e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (c6c1ec37-066c-4433-92e8-2919971b1a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:31 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547 Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0028075-3ab3-418b-b6c0-f3f0a92f4e08]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:31 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b9dca8eb-011d-4e61-9e4e-affa7e550013 tempest-ProjectReaderTests-461785946 None] Created volume successfully. Nov 03 07:51:31 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 Nov 03 07:51:31 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:31 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2.344d8579-a575-49bc-810e-5c8e34f00547" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-344d8579-a575-49bc-810e-5c8e34f00547" released by "_delete_snapshot" :: held 1.992s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-010e6dbc-b6e7-48d2-8b6d-3635194976f2" released by "delete_snapshot" :: held 2.031s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Created reservations ['8cfaaa4d-bdf3-4026-95a5-9c43f15eafc9', '1d966ba4-fdf6-413f-abbd-e85f976460ca', '355f4b1f-4cf8-47c0-844a-39bbbdeda91b', '604d443a-800f-45f1-a1d8-e3e937ef491a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:31 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:51:31 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 1G Nov 03 07:51:31 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd56d2de-8265-4736-a3c2-daed478dd01b tempest-ProjectMemberTests-948307073 None] Lock "cinder-344d8579-a575-49bc-810e-5c8e34f00547-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:32 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 1G" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d00c39-0514-4eda-b911-f42156f30938 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:32 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d00c39-0514-4eda-b911-f42156f30938 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 Nov 03 07:51:32 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-cd952c3b-4e9b-4334-aa6e-a630f4b0664e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Lock "cinder-cd952c3b-4e9b-4334-aa6e-a630f4b0664e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-quobyte-cd952c3b-4e9b-4334-aa6e-a630f4b0664e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-cd952c3b-4e9b-4334-aa6e-a630f4b0664e" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[68323252-000c-47fa-b263-c5a3444efedd]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:32 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d00c39-0514-4eda-b911-f42156f30938 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:32 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 is being set with open permissions: ugo+rw Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:32 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 Nov 03 07:51:32 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:32 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e Nov 03 07:51:32 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-010e6dbc-b6e7-48d2-8b6d-3635194976f2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Lock "cinder-010e6dbc-b6e7-48d2-8b6d-3635194976f2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:32 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-010e6dbc-b6e7-48d2-8b6d-3635194976f2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-010e6dbc-b6e7-48d2-8b6d-3635194976f2" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:33 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info Nov 03 07:51:33 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e" returned: 0 in 0.508s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99786c-7d89-4524-aee4-6c309f5d39e7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:33 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e Nov 03 07:51:33 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:33 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 Nov 03 07:51:33 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:33 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info is being set with open permissions: ugo+rw Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:33 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-cd952c3b-4e9b-4334-aa6e-a630f4b0664e" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info Nov 03 07:51:33 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-cd952c3b-4e9b-4334-aa6e-a630f4b0664e" released by "delete_volume" :: held 0.879s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Created reservations ['9240c397-62b4-4c91-b27e-05ae1c94a269', '2ae6c308-9e83-40ed-851a-ae640dcd2d9e', 'dd6533c8-807f-4051-9584-115f0f958fac', 'b9f8ed2e-91b4-4c1d-a36e-1df01cc51cb5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:33 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:33 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2 Nov 03 07:51:33 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:33 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:33 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:33 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.info" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eb3b5202-ad7e-48de-872b-0dcf136d96e2 tempest-CinderUnicodeTest-1599504501 None] Create snapshot completed successfully Nov 03 07:51:33 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:33 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-010e6dbc-b6e7-48d2-8b6d-3635194976f2" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Deleted volume successfully. Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-010e6dbc-b6e7-48d2-8b6d-3635194976f2" released by "delete_volume" :: held 0.968s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-965a375a-7107-4f9e-92a5-b8b61d3beabe tempest-ProjectReaderTests-461785946 None] Lock "cinder-cd952c3b-4e9b-4334-aa6e-a630f4b0664e-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Created reservations ['d82e307d-c7a3-4626-b6af-6aa12af14af5', '6d8b1640-11f6-4cf3-989c-ae68054c4b53', 'd997c59e-0e74-464d-b929-8d97da51c93d', 'b08c3eca-07f8-4c2a-9787-777af024bec6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:34 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:34 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (4d6834c5-5a13-4da6-8f23-44ebcc1e6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85d0fd6-4999-4872-be3d-05eb11ef1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85d0fd6-4999-4872-be3d-05eb11ef1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932387510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91b5aee-bab0-487f-bce1-dbcb86a8c24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:34Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bd9d08-c6b6-462b-9115-e2f8d2c75a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bd9d08-c6b6-462b-9115-e2f8d2c75a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd22c309-961a-4551-b7fe-27b9676fed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd22c309-961a-4551-b7fe-27b9676fed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91b5aee-bab0-487f-bce1-dbcb86a8c24a', 'volume_name': 'volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf50f84-1dbc-449a-adf1-5b428b0c30a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf50f84-1dbc-449a-adf1-5b428b0c30a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7f37ca-901b-4628-a73a-8dc57fef6d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Volume e91b5aee-bab0-487f-bce1-dbcb86a8c24a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a', 'volume_size': 1} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932387510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91b5aee-bab0-487f-bce1-dbcb86a8c24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:34Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Creating volume e91b5aee-bab0-487f-bce1-dbcb86a8c24a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:34 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:34 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:34 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a 1073741824 Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-4aacbd96-0a19-47c4-ae35-6e980eaebea5-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:34 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-4aacbd96-0a19-47c4-ae35-6e980eaebea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-quobyte-35d00c39-0514-4eda-b911-f42156f30938" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-832c2b3a-0e38-4973-851c-a8d6ebb50a19 tempest-ProjectMemberTests-948307073 None] Lock "cinder-010e6dbc-b6e7-48d2-8b6d-3635194976f2-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-35d00c39-0514-4eda-b911-f42156f30938" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-quobyte-4aacbd96-0a19-47c4-ae35-6e980eaebea5" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-4aacbd96-0a19-47c4-ae35-6e980eaebea5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Deleting offline snapshot 4aacbd96-0a19-47c4-ae35-6e980eaebea5 of volume 35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] snapshot_file for this snap is: volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8e073-9333-4fb0-804b-77f43d1f13ae]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:34 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 Nov 03 07:51:34 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a 1073741824" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5" returned: 0 in 0.435s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d00c39-0514-4eda-b911-f42156f30938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:35 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a Nov 03 07:51:35 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49df278-0309-4a05-b594-36aef9069e95]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 Nov 03 07:51:35 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7f37ca-901b-4628-a73a-8dc57fef6d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1f9dc9-2b26-42ec-aa32-149c27b2e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Volume volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a (e91b5aee-bab0-487f-bce1-dbcb86a8c24a): created successfully Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1f9dc9-2b26-42ec-aa32-149c27b2e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (4d6834c5-5a13-4da6-8f23-44ebcc1e6726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1f180fe0-7385-4a30-87c7-7b5c1d3da28a tempest-ProjectReaderTests-461785946 None] Created volume successfully. Nov 03 07:51:35 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 Nov 03 07:51:35 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (4a22f7da-4115-4568-8454-0f5d7d9c9728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2fc1e0-7b64-433b-9578-20b886e2edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2fc1e0-7b64-433b-9578-20b886e2edba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968090124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983ba9eb-b6e7-4871-9841-5519f0734623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:36Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2728ff2d-c3af-4af1-9342-d01a3e57b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2728ff2d-c3af-4af1-9342-d01a3e57b039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b4e644-ab1d-4359-b958-40ab0587d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b4e644-ab1d-4359-b958-40ab0587d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983ba9eb-b6e7-4871-9841-5519f0734623', 'volume_name': 'volume-983ba9eb-b6e7-4871-9841-5519f0734623', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf31dcb-fcb1-48f9-9419-5d31d5bf3acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf31dcb-fcb1-48f9-9419-5d31d5bf3acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128f6b52-b981-4346-a3ee-2c2dd981768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Volume 983ba9eb-b6e7-4871-9841-5519f0734623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983ba9eb-b6e7-4871-9841-5519f0734623', 'volume_size': 1} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968090124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983ba9eb-b6e7-4871-9841-5519f0734623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:36Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Creating volume 983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 1073741824 Nov 03 07:51:35 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5 Nov 03 07:51:36 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938.4aacbd96-0a19-47c4-ae35-6e980eaebea5" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-4aacbd96-0a19-47c4-ae35-6e980eaebea5" released by "_delete_snapshot" :: held 1.859s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-35d00c39-0514-4eda-b911-f42156f30938" released by "delete_snapshot" :: held 1.884s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:36 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 1073741824" returned: 0 in 0.567s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Created reservations ['d87d57f6-a85e-4a1f-b4d5-4877306bbf5e', '5b124b84-b7cf-4c87-b5c4-1269b80a5a57', '81566dad-0cd8-4eeb-94dd-80402c000028', '45911870-4267-49e8-b966-ba471d9c2141'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-e91b5aee-bab0-487f-bce1-dbcb86a8c24a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Lock "cinder-e91b5aee-bab0-487f-bce1-dbcb86a8c24a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:36 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 Nov 03 07:51:36 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Delete snapshot completed successfully. Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-quobyte-e91b5aee-bab0-487f-bce1-dbcb86a8c24a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-993ede3a-32cb-4d77-8c1c-5b6cd742c6c3 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-4aacbd96-0a19-47c4-ae35-6e980eaebea5-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-35d00c39-0514-4eda-b911-f42156f30938-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-e91b5aee-bab0-487f-bce1-dbcb86a8c24a" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56263c9-fa36-4651-9a31-7f6d8ae4cdfe]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-35d00c39-0514-4eda-b911-f42156f30938-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-quobyte-35d00c39-0514-4eda-b911-f42156f30938" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-35d00c39-0514-4eda-b911-f42156f30938" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:36 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a Nov 03 07:51:36 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c699e0-c698-405b-9f7f-8f0dcf4cc4c1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128f6b52-b981-4346-a3ee-2c2dd981768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983ba9eb-b6e7-4871-9841-5519f0734623', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae32a633-492a-4916-8291-66d9a6ae51c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Volume volume-983ba9eb-b6e7-4871-9841-5519f0734623 (983ba9eb-b6e7-4871-9841-5519f0734623): created successfully Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae32a633-492a-4916-8291-66d9a6ae51c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (4a22f7da-4115-4568-8454-0f5d7d9c9728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f23f6159-b675-48a0-b659-2d935ac424a5 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:51:37 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 Nov 03 07:51:37 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a" returned: 0 in 0.511s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a Nov 03 07:51:37 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938 Nov 03 07:51:37 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-e91b5aee-bab0-487f-bce1-dbcb86a8c24a" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-e91b5aee-bab0-487f-bce1-dbcb86a8c24a" released by "delete_volume" :: held 0.860s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Created reservations ['3302d441-227d-46b1-8fe7-e5485d1369f9', '720951bf-106e-4b1e-b972-39d0fa0d4ee8', 'ca70cfa8-240e-4712-b6e0-a50275e8c2b9', 'd704c74b-b115-45dd-9203-6811f85cecd0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-35d00c39-0514-4eda-b911-f42156f30938" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:37 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-35d00c39-0514-4eda-b911-f42156f30938" released by "delete_volume" :: held 0.897s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Created reservations ['5494ea42-0e4e-4336-bd89-42c014c8e159', '210203eb-dafd-475c-aab7-726cc088f38b', '9784f1af-df6a-448b-baf7-0d5413da7897', '800165fe-49a1-4d7c-b854-b31baed68792'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:38 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Deleted volume successfully. Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9112a16d-d650-452b-818e-f9b52059dca9 tempest-ProjectReaderTests-461785946 None] Lock "cinder-e91b5aee-bab0-487f-bce1-dbcb86a8c24a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:38 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-c8b188b3-cf8e-4b07-9681-a641821cc28a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Deleted volume successfully. Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a054ea93-c36d-4523-aabd-f16a5dbbcf49 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-35d00c39-0514-4eda-b911-f42156f30938-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-c8b188b3-cf8e-4b07-9681-a641821cc28a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "cinder-quobyte-c8b188b3-cf8e-4b07-9681-a641821cc28a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-c8b188b3-cf8e-4b07-9681-a641821cc28a" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (b50ad3b4-1040-4f3a-a01b-f05d1022089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04892351-e761-4d32-b9ae-df18981e6701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4634d48d-0a70-4838-aeaf-2992450567ab]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Creating offline snapshot d4c10215-0a93-415d-b591-399ee788077b of volume 983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04892351-e761-4d32-b9ae-df18981e6701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315621478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffe9875-53cf-4818-8e97-b74f4bbb4ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:38Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39a1ff-9b3b-4904-9323-aff0d3c21074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39a1ff-9b3b-4904-9323-aff0d3c21074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2a2192-36f8-407a-b535-fda26ab443db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2a2192-36f8-407a-b535-fda26ab443db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffe9875-53cf-4818-8e97-b74f4bbb4ddb', 'volume_name': 'volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b066a06-01f9-411a-b128-4f6116282a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b066a06-01f9-411a-b128-4f6116282a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edc6228-3855-4ef8-84ca-d6d20e825976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Volume 6ffe9875-53cf-4818-8e97-b74f4bbb4ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb', 'volume_size': 1} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e8ea6e-6693-464c-a6ef-4b556b9539c2]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a Nov 03 07:51:38 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 Nov 03 07:51:38 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a Nov 03 07:51:39 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b 1G Nov 03 07:51:39 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-c8b188b3-cf8e-4b07-9681-a641821cc28a" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-quobyte-c8b188b3-cf8e-4b07-9681-a641821cc28a" released by "delete_volume" :: held 0.767s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Created reservations ['1072ebcb-349d-484d-b7b0-838c61da8aee', '57b05267-1e83-4732-b825-1decb0d1f776', '70ef0a41-a98f-4c81-a1ff-607bf0387e86', '73bd3cf3-79fb-46c1-ba40-620c2aed1038'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:39 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b 1G" returned: 0 in 0.606s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983ba9eb-b6e7-4871-9841-5519f0734623 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983ba9eb-b6e7-4871-9841-5519f0734623 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b Nov 03 07:51:39 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Deleted volume successfully. Nov 03 07:51:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4e73fa77-511f-4577-80a5-f9520831d401 tempest-CinderUnicodeTest-1599504501 None] Lock "cinder-c8b188b3-cf8e-4b07-9681-a641821cc28a-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:40 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983ba9eb-b6e7-4871-9841-5519f0734623 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b" returned: 0 in 0.354s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b is being set with open permissions: ugo+rw Nov 03 07:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b Nov 03 07:51:40 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:40 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info Nov 03 07:51:40 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:40 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info is being set with open permissions: ugo+rw Nov 03 07:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info Nov 03 07:51:40 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:41 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.info" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315621478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffe9875-53cf-4818-8e97-b74f4bbb4ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309c2021fd3f43568752d87ea05a273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:38Z,use_quota=True,user_id='2f095a3a54ae400281891d683d919d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Creating volume 6ffe9875-53cf-4818-8e97-b74f4bbb4ddb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:41 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb 1073741824 Nov 03 07:51:41 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b991564b-0197-425e-a71d-ef4e2646969b tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-d4c10215-0a93-415d-b591-399ee788077b-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Lock "cinder-d4c10215-0a93-415d-b591-399ee788077b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-983ba9eb-b6e7-4871-9841-5519f0734623" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-983ba9eb-b6e7-4871-9841-5519f0734623" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-d4c10215-0a93-415d-b591-399ee788077b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:41 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-d4c10215-0a93-415d-b591-399ee788077b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot d4c10215-0a93-415d-b591-399ee788077b of volume 983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb 1073741824" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd3bddc-a995-4c83-a781-c18e294664dd]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:41 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb Nov 03 07:51:41 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:41 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b Nov 03 07:51:41 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edc6228-3855-4ef8-84ca-d6d20e825976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ec7b03-a6ba-4e64-b8ac-0516a74a4548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Volume volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb (6ffe9875-53cf-4818-8e97-b74f4bbb4ddb): created successfully Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ec7b03-a6ba-4e64-b8ac-0516a74a4548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Flow 'volume_create_manager' (b50ad3b4-1040-4f3a-a01b-f05d1022089a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-533b4569-236c-4daa-aca7-d6abc8c1c029 tempest-ProjectReaderTests-461785946 None] Created volume successfully. Nov 03 07:51:42 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b" returned: 0 in 0.466s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-983ba9eb-b6e7-4871-9841-5519f0734623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e502e439-ec50-4bb7-ac6a-17b0e6324418]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:42 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 Nov 03 07:51:42 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623" returned: 0 in 0.484s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:42 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b Nov 03 07:51:42 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Lock "cinder-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Acquiring lock "cinder-quobyte-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3452ae0-be6f-4df5-81fc-ce63f9606742]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:43 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb Nov 03 07:51:43 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:43 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:43 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b Nov 03 07:51:43 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:43 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:43 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623.d4c10215-0a93-415d-b591-399ee788077b" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:43 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb Nov 03 07:51:43 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-d4c10215-0a93-415d-b591-399ee788077b" released by "_delete_snapshot" :: held 1.935s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-983ba9eb-b6e7-4871-9841-5519f0734623" released by "delete_snapshot" :: held 1.974s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Created reservations ['39b19c95-c267-4be7-b185-93b665c8e41e', 'c91445b3-9d5a-4dad-baf0-dda1b8d30f81', '319a06b9-47bb-4fb5-be6e-a7f96f95a649', '07cd87e5-8d26-43d7-868b-849132a161d1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b886ecb7-1eed-4d6b-b9f3-d787dd457680 tempest-ProjectAdminTests-911017264 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7365684509277, 'free_capacity_gb': 1773.7365684509277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:51:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce8a4d80-fdf2-4c03-9f04-f62c4a7ed16d tempest-ProjectMemberTests-948307073 None] Lock "cinder-d4c10215-0a93-415d-b591-399ee788077b-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Lock "cinder-quobyte-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb" released by "delete_volume" :: held 0.945s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-983ba9eb-b6e7-4871-9841-5519f0734623-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Lock "cinder-983ba9eb-b6e7-4871-9841-5519f0734623-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-983ba9eb-b6e7-4871-9841-5519f0734623" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Created reservations ['06db61b6-9116-4627-a3aa-fa15cf220995', '0b0446dc-6666-456f-8f3c-145b0b469834', '8eeb2fc2-6227-4276-85d4-451ee581a484', '3ac12f75-cfec-4346-8e48-946d9acd9248'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-983ba9eb-b6e7-4871-9841-5519f0734623" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfff2c6f-11ee-4e0c-9cef-dc79807f8a0d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:44 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 Nov 03 07:51:44 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Deleted volume successfully. Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0858fe2a-394d-497f-a7ab-aae935fa4a47 tempest-ProjectReaderTests-461785946 None] Lock "cinder-6ffe9875-53cf-4818-8e97-b74f4bbb4ddb-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:44 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623" returned: 0 in 0.516s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623 Nov 03 07:51:44 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-983ba9eb-b6e7-4871-9841-5519f0734623" returned: 0 in 0.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-983ba9eb-b6e7-4871-9841-5519f0734623" released by "delete_volume" :: held 0.885s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Created reservations ['c3199830-af45-42d1-b148-fc34d339210d', '15187892-9e9f-425a-a760-f27df1a6b014', 'd4553dcc-6d98-41be-9e17-6c90a8df1a93', '5d40558b-97f8-4146-9240-d2668c87abb2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:45 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:45 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:45 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.470s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2929a767-3666-42a0-bad8-ca8e6fd0e71d tempest-ProjectMemberTests-948307073 None] Lock "cinder-983ba9eb-b6e7-4871-9841-5519f0734623-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (4f52a835-0133-40cd-9ffc-60b526a09af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443573ad-b656-4c94-be03-cbce30316da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443573ad-b656-4c94-be03-cbce30316da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709413109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab550984-6440-414b-8f26-f3041f52e649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:46Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258bb118-3905-4d12-9fe9-43630edabfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258bb118-3905-4d12-9fe9-43630edabfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecb3537-f967-45d7-aef0-631b0b91c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecb3537-f967-45d7-aef0-631b0b91c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab550984-6440-414b-8f26-f3041f52e649', 'volume_name': 'volume-ab550984-6440-414b-8f26-f3041f52e649', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50100c7-2b4f-4673-a60d-2fe3614319bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50100c7-2b4f-4673-a60d-2fe3614319bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df61bec9-9064-4523-933e-8b2c4717f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Volume ab550984-6440-414b-8f26-f3041f52e649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab550984-6440-414b-8f26-f3041f52e649', 'volume_size': 1} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709413109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab550984-6440-414b-8f26-f3041f52e649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:46Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Creating volume ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:45 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:45 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 1073741824 Nov 03 07:51:45 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:46 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 1073741824" returned: 0 in 0.601s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:46 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 Nov 03 07:51:46 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:47 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df61bec9-9064-4523-933e-8b2c4717f969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab550984-6440-414b-8f26-f3041f52e649', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d91683b-723f-4b19-97c4-d4d680de1c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Volume volume-ab550984-6440-414b-8f26-f3041f52e649 (ab550984-6440-414b-8f26-f3041f52e649): created successfully Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d91683b-723f-4b19-97c4-d4d680de1c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (4f52a835-0133-40cd-9ffc-60b526a09af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1587d0a2-3298-4712-9b83-843b15313ff8 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Creating offline snapshot 9c616eb1-4c65-464e-a9a7-43eb30c617c4 of volume ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[13584b4d-d7d2-48d2-a801-d62921c6fc13]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:48 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 Nov 03 07:51:48 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:48 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:48 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 1G Nov 03 07:51:48 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:49 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 1G" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab550984-6440-414b-8f26-f3041f52e649 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab550984-6440-414b-8f26-f3041f52e649 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 Nov 03 07:51:49 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (805775ea-d440-4b24-b534-9eaccc16ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da1991f-02c9-4dca-b62c-8c39ddd4bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da1991f-02c9-4dca-b62c-8c39ddd4bd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823859680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5d33ee-e013-44c8-943e-9ea7a053efe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:49Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff898edc-a592-4151-bfc9-3bd8b42649fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff898edc-a592-4151-bfc9-3bd8b42649fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd440afa-9d97-44a7-bc07-4739e957278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd440afa-9d97-44a7-bc07-4739e957278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5d33ee-e013-44c8-943e-9ea7a053efe9', 'volume_name': 'volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6cac8c-8f1d-463b-befe-57c335d51566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6cac8c-8f1d-463b-befe-57c335d51566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f54f0a5-5153-4c27-83a4-19db8475b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Volume 0d5d33ee-e013-44c8-943e-9ea7a053efe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9', 'volume_size': 1} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:49 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab550984-6440-414b-8f26-f3041f52e649 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4" returned: 0 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 is being set with open permissions: ugo+rw Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 Nov 03 07:51:49 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:49 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4" returned: 0 in 0.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info Nov 03 07:51:49 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:49 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info is being set with open permissions: ugo+rw Nov 03 07:51:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info Nov 03 07:51:49 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:50 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.info" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823859680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5d33ee-e013-44c8-943e-9ea7a053efe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:49Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Creating volume 0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:50 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 1073741824 Nov 03 07:51:50 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-08b22115-772d-4fd5-bcf5-0c36be543cf4 tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:51:50 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 1073741824" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:50 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 Nov 03 07:51:50 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:50 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f54f0a5-5153-4c27-83a4-19db8475b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92356cca-6ab2-485b-b5b0-9975a1a87bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Volume volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 (0d5d33ee-e013-44c8-943e-9ea7a053efe9): created successfully Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92356cca-6ab2-485b-b5b0-9975a1a87bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (805775ea-d440-4b24-b534-9eaccc16ec77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-47c50d7b-63ff-4414-91f4-a2a72b7f70d3 tempest-ProjectReaderTests-480918553 None] Created volume successfully. Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-9c616eb1-4c65-464e-a9a7-43eb30c617c4-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Lock "cinder-9c616eb1-4c65-464e-a9a7-43eb30c617c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-ab550984-6440-414b-8f26-f3041f52e649" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-ab550984-6440-414b-8f26-f3041f52e649" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-9c616eb1-4c65-464e-a9a7-43eb30c617c4" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Creating offline snapshot 653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 of volume 0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-9c616eb1-4c65-464e-a9a7-43eb30c617c4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot 9c616eb1-4c65-464e-a9a7-43eb30c617c4 of volume ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35992c5-22b3-4a44-bd85-faa83c249fda]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f20203f-d989-43ee-b6c9-bca287963630]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 Nov 03 07:51:51 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:51 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 Nov 03 07:51:51 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:51 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab550984-6440-414b-8f26-f3041f52e649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:51 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 1G Nov 03 07:51:51 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c697d-e375-4808-9a71-fe9d7fb04b05]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 Nov 03 07:51:51 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 1G" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 Nov 03 07:51:52 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 Nov 03 07:51:52 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 is being set with open permissions: ugo+rw Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 Nov 03 07:51:52 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4 Nov 03 07:51:52 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649.9c616eb1-4c65-464e-a9a7-43eb30c617c4" returned: 0 in 0.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-9c616eb1-4c65-464e-a9a7-43eb30c617c4" released by "_delete_snapshot" :: held 1.413s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:52 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info Nov 03 07:51:52 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-ab550984-6440-414b-8f26-f3041f52e649" released by "delete_snapshot" :: held 1.446s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Created reservations ['6d6ea499-b3a3-406b-bf28-6c786085509a', 'b25d705d-7e2c-431a-b522-be4b94e12309', 'c214e7a6-6e8c-4d06-9397-be0d0c38fb97', '9985b6a9-6b18-486f-be6e-fdf330c6ff8d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:51:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-465ef560-2007-4c3b-b43c-075b157b48e2 tempest-ProjectMemberTests-948307073 None] Lock "cinder-9c616eb1-4c65-464e-a9a7-43eb30c617c4-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:53 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:53 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info is being set with open permissions: ugo+rw Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:53 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info Nov 03 07:51:53 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:53 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.info" returned: 0 in 0.240s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-738f8a37-b0af-4d30-a4d3-7552ed57143b tempest-ProjectReaderTests-480918553 None] Create snapshot completed successfully Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-ab550984-6440-414b-8f26-f3041f52e649-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Lock "cinder-ab550984-6440-414b-8f26-f3041f52e649-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-ab550984-6440-414b-8f26-f3041f52e649" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-ab550984-6440-414b-8f26-f3041f52e649" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9e32f-2f48-46c8-aa84-ebd3ea396966]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Lock "cinder-653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-0d5d33ee-e013-44c8-943e-9ea7a053efe9" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0d5d33ee-e013-44c8-943e-9ea7a053efe9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Deleting offline snapshot 653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 of volume 0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] snapshot_file for this snap is: volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f7c071-8072-49fa-be89-11a3f353f8de]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:53 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 Nov 03 07:51:53 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:53 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 Nov 03 07:51:53 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649 Nov 03 07:51:54 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62d5f44-42a9-4295-8117-4c656fa604c2]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 Nov 03 07:51:54 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-ab550984-6440-414b-8f26-f3041f52e649" returned: 0 in 0.240s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-ab550984-6440-414b-8f26-f3041f52e649" released by "delete_volume" :: held 0.693s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Created reservations ['c2502ec6-1b81-4bbe-9ae6-3a79fdee2260', '20ed94dd-4ffc-4279-a997-55d882acf08c', '6234e4a3-1c3a-4b4d-afea-da751d3f0d64', '9ee95844-8462-448a-b69a-adfe29d2d765'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:54 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:54 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 Nov 03 07:51:54 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b410631e-1033-4eb1-80c8-de5d82b42fd6 tempest-ProjectMemberTests-948307073 None] Lock "cinder-ab550984-6440-414b-8f26-f3041f52e649-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:54 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:51:54 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0 Nov 03 07:51:54 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9.653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (92819c35-a13f-4ef3-8f3a-919a47e046f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b52307f-a1e0-4787-9063-ef5d6a328c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b52307f-a1e0-4787-9063-ef5d6a328c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038586165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668ff0bd-66eb-4a75-b4d6-0f05953f4580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:55Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8785761-be54-48ea-bdea-c723cc7645b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8785761-be54-48ea-bdea-c723cc7645b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34373900-8952-4563-ae59-ac628f1dce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34373900-8952-4563-ae59-ac628f1dce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668ff0bd-66eb-4a75-b4d6-0f05953f4580', 'volume_name': 'volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ca1590-f96f-4710-b35b-a68839f9215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ca1590-f96f-4710-b35b-a68839f9215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90f2261-4cb2-48b3-8bb9-bd9a650b561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Volume 668ff0bd-66eb-4a75-b4d6-0f05953f4580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580', 'volume_size': 1} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038586165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668ff0bd-66eb-4a75-b4d6-0f05953f4580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:55Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Creating volume 668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0" released by "_delete_snapshot" :: held 1.613s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0d5d33ee-e013-44c8-943e-9ea7a053efe9" released by "delete_snapshot" :: held 1.643s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:55 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 1073741824 Nov 03 07:51:55 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Created reservations ['f7a79684-b58d-4e7e-9e30-7ef01c73b67b', '02edf2fe-f40f-4d98-8c7d-79887d4ea80a', 'b7731803-8a45-4e19-88f8-35f2b5411373', 'e477b00b-e0f5-4df9-95bc-fe7003a8e37c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Delete snapshot completed successfully. Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a2938de8-bb36-4551-ab9a-4ddde56a1a5e tempest-ProjectReaderTests-480918553 None] Lock "cinder-653c5dc6-3937-4cf8-bc4d-b6fbc5672cf0-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:55 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 1073741824" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:55 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 Nov 03 07:51:55 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-0d5d33ee-e013-44c8-943e-9ea7a053efe9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Lock "cinder-0d5d33ee-e013-44c8-943e-9ea7a053efe9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-0d5d33ee-e013-44c8-943e-9ea7a053efe9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0d5d33ee-e013-44c8-943e-9ea7a053efe9" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a4d3d-3f60-43bc-9f22-d2fcfc829467]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:56 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580" returned: 0 in 0.315s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90f2261-4cb2-48b3-8bb9-bd9a650b561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c8f7a0-fe98-4b7a-9c3b-93da6c46e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Volume volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 (668ff0bd-66eb-4a75-b4d6-0f05953f4580): created successfully Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c8f7a0-fe98-4b7a-9c3b-93da6c46e575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (92819c35-a13f-4ef3-8f3a-919a47e046f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:56 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 Nov 03 07:51:56 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-14638d7c-be06-4463-b13a-72ae4d583996 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:51:56 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:56 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9 Nov 03 07:51:56 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:56 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0d5d33ee-e013-44c8-943e-9ea7a053efe9" returned: 0 in 0.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0d5d33ee-e013-44c8-943e-9ea7a053efe9" released by "delete_volume" :: held 0.696s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Created reservations ['eb948234-20b0-4997-936c-c20e9cfd95c6', 'aa2fe957-c8b1-4d9a-864f-14d674381414', '3f62f416-9c08-4cec-ae6e-b6b4e263bec3', '92f9255f-5b9a-4e5f-a270-c050fc03e28e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:56 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:51:56 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:57 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.262s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Deleted volume successfully. Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5a638d40-e80c-414e-b4f9-8b92e0175dc7 tempest-ProjectReaderTests-480918553 None] Lock "cinder-0d5d33ee-e013-44c8-943e-9ea7a053efe9-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (331a156e-6789-4a69-addb-4b0dbf9decfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a00fa1-ebf8-4029-b060-d93c10cd6358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Creating offline snapshot 5f1b8665-bb93-4fd1-b130-c9201a8d8c4a of volume 668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a00fa1-ebf8-4029-b060-d93c10cd6358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939270577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa25c80-97a9-4fe0-bc1c-48033c760c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:58Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee25e3c-0a91-496e-9693-3db6d8aca878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee25e3c-0a91-496e-9693-3db6d8aca878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87576bd9-8181-458b-965b-1a493d0c67fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87576bd9-8181-458b-965b-1a493d0c67fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa25c80-97a9-4fe0-bc1c-48033c760c02', 'volume_name': 'volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1b27e1-6c6f-45fd-9bb7-e0bc6145378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1b27e1-6c6f-45fd-9bb7-e0bc6145378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa904f1-53cb-4104-be68-45ffa7609518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Volume aaa25c80-97a9-4fe0-bc1c-48033c760c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02', 'volume_size': 1} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea83943d-a191-477a-8dd0-3087c8365a75]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:57 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 Nov 03 07:51:57 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:58 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:58 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a 1G Nov 03 07:51:58 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:58 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a 1G" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:58 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a Nov 03 07:51:58 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:58 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:58 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a is being set with open permissions: ugo+rw Nov 03 07:51:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:58 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a Nov 03 07:51:58 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:59 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info Nov 03 07:51:59 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:59 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info is being set with open permissions: ugo+rw Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:59 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info Nov 03 07:51:59 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.info" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939270577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa25c80-97a9-4fe0-bc1c-48033c760c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:58Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Creating volume aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:59 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:59 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 1073741824 Nov 03 07:51:59 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-028914f3-daed-47b3-8a0f-44d987821cc5 tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:52:00 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 1073741824" returned: 0 in 0.413s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:00 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 Nov 03 07:52:00 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:00 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa904f1-53cb-4104-be68-45ffa7609518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fbea46-cda4-4845-b6d4-76926460b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Volume volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 (aaa25c80-97a9-4fe0-bc1c-48033c760c02): created successfully Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fbea46-cda4-4845-b6d4-76926460b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (331a156e-6789-4a69-addb-4b0dbf9decfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8b2caeb2-a8ef-4fda-8c9e-2f5ece4bee58 tempest-ProjectReaderTests-480918553 None] Created volume successfully. Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-5f1b8665-bb93-4fd1-b130-c9201a8d8c4a-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Lock "cinder-5f1b8665-bb93-4fd1-b130-c9201a8d8c4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-668ff0bd-66eb-4a75-b4d6-0f05953f4580" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-668ff0bd-66eb-4a75-b4d6-0f05953f4580" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot 5f1b8665-bb93-4fd1-b130-c9201a8d8c4a of volume 668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce63ce76-312b-4b7e-8628-42d221eacb3f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:00 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a Nov 03 07:52:00 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Creating offline snapshot 56335de8-9235-44df-b73f-f3e51b1aa77e of volume aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[72982a41-1f97-462f-98f5-a7d83186a1e8]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:01 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 Nov 03 07:52:01 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a95fb0-245b-4149-b898-0919bcfcffaf]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:01 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 Nov 03 07:52:01 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02" returned: 0 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:01 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e 1G Nov 03 07:52:01 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580" returned: 0 in 0.357s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:01 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a Nov 03 07:52:01 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e 1G" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:01 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e Nov 03 07:52:01 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:01 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a Nov 03 07:52:01 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e is being set with open permissions: ugo+rw Nov 03 07:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:02 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e Nov 03 07:52:02 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:02 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580.5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-5f1b8665-bb93-4fd1-b130-c9201a8d8c4a" released by "_delete_snapshot" :: held 1.452s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-668ff0bd-66eb-4a75-b4d6-0f05953f4580" released by "delete_snapshot" :: held 1.478s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Created reservations ['76cc6fc3-1096-4052-b0b9-a141db82b06f', '808b3801-2bee-4fae-9699-72ef8378ddbf', 'f4b6e12f-0ef2-43b0-8394-c796454659f1', 'd7ca4b2b-aa18-4730-920b-98a10ab32c11'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a8aaddb2-1d23-4d73-957b-9becb621e9a9 tempest-ProjectMemberTests-948307073 None] Lock "cinder-5f1b8665-bb93-4fd1-b130-c9201a8d8c4a-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:02 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:02 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info Nov 03 07:52:02 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:02 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info is being set with open permissions: ugo+rw Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:02 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info Nov 03 07:52:02 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:02 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.info" returned: 0 in 0.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-668ff0bd-66eb-4a75-b4d6-0f05953f4580-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-668ff0bd-66eb-4a75-b4d6-0f05953f4580-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cc114ddf-78ef-41f3-bfce-3d3e434208d2 tempest-ProjectReaderTests-480918553 None] Create snapshot completed successfully Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-668ff0bd-66eb-4a75-b4d6-0f05953f4580" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-668ff0bd-66eb-4a75-b4d6-0f05953f4580" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c513836-24cd-48bd-81d3-f96a73777d0e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-56335de8-9235-44df-b73f-f3e51b1aa77e-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:03 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 Nov 03 07:52:03 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Lock "cinder-56335de8-9235-44df-b73f-f3e51b1aa77e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-aaa25c80-97a9-4fe0-bc1c-48033c760c02" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-aaa25c80-97a9-4fe0-bc1c-48033c760c02" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-56335de8-9235-44df-b73f-f3e51b1aa77e" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-56335de8-9235-44df-b73f-f3e51b1aa77e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Deleting offline snapshot 56335de8-9235-44df-b73f-f3e51b1aa77e of volume aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] snapshot_file for this snap is: volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacbb7e6-4ad3-4d58-a701-196527a02389]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e Nov 03 07:52:03 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580 Nov 03 07:52:03 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5371cc16-9a08-45c1-a958-c2f46719999f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-668ff0bd-66eb-4a75-b4d6-0f05953f4580" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-668ff0bd-66eb-4a75-b4d6-0f05953f4580" released by "delete_volume" :: held 0.716s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:03 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 Nov 03 07:52:03 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Created reservations ['610a9c60-5328-47ed-8662-1b5567f3676e', '0447c7f5-bfd7-49e1-ad8a-c0d3a9cdbd89', '28d18fd4-9dd1-4e10-b04b-1388e34919aa', 'dc056a0e-4560-4a3c-8a1e-8ebf870af155'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:03 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e Nov 03 07:52:03 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:52:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bf587e6b-d01a-47ac-bc23-a6992b491ce8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-668ff0bd-66eb-4a75-b4d6-0f05953f4580-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:04 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:04 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e Nov 03 07:52:04 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (d04e4d47-6bab-4364-a182-1d6b640c84ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7af6c-f700-471e-91f1-95d90bde224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7af6c-f700-471e-91f1-95d90bde224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990513473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33e1e5b-0491-45f6-9d5d-1f6595782bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:04Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e193c7a-764c-43dc-8c68-69978c468573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e193c7a-764c-43dc-8c68-69978c468573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef368929-3f95-49d8-a651-7eb08d3c574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef368929-3f95-49d8-a651-7eb08d3c574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33e1e5b-0491-45f6-9d5d-1f6595782bd8', 'volume_name': 'volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442e01b9-834d-4592-90f2-06d507edda43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442e01b9-834d-4592-90f2-06d507edda43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db07fd13-e1e2-44a2-8752-ee77c73fb697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Volume a33e1e5b-0491-45f6-9d5d-1f6595782bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8', 'volume_size': 1} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990513473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33e1e5b-0491-45f6-9d5d-1f6595782bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:04Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Creating volume a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:04 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 1073741824 Nov 03 07:52:04 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:04 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02.56335de8-9235-44df-b73f-f3e51b1aa77e" returned: 0 in 0.256s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-56335de8-9235-44df-b73f-f3e51b1aa77e" released by "_delete_snapshot" :: held 1.489s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-aaa25c80-97a9-4fe0-bc1c-48033c760c02" released by "delete_snapshot" :: held 1.512s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Created reservations ['3fb9291f-76c4-4f76-b0e2-426dc5ce8cf2', '24fcf59b-bc4c-4461-ac59-40cadb0025c7', 'da721853-bd55-47fa-988c-61c0f66ab565', 'd54f287d-2b30-44d7-aeaf-f6c2a352a5d8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Delete snapshot completed successfully. Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e265533-f9eb-4fee-a2a2-ef20ad6a6416 tempest-ProjectReaderTests-480918553 None] Lock "cinder-56335de8-9235-44df-b73f-f3e51b1aa77e-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:04 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 1073741824" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:04 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 Nov 03 07:52:04 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db07fd13-e1e2-44a2-8752-ee77c73fb697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eadc2b9-8d33-4b10-857c-ecb902a1c7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-aaa25c80-97a9-4fe0-bc1c-48033c760c02-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Volume volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 (a33e1e5b-0491-45f6-9d5d-1f6595782bd8): created successfully Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eadc2b9-8d33-4b10-857c-ecb902a1c7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (d04e4d47-6bab-4364-a182-1d6b640c84ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Lock "cinder-aaa25c80-97a9-4fe0-bc1c-48033c760c02-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-be7bb632-76e4-401d-8e12-2c7d8980758d tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-aaa25c80-97a9-4fe0-bc1c-48033c760c02" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-aaa25c80-97a9-4fe0-bc1c-48033c760c02" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a87b392-b4b7-41fc-8472-3293c670992b]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 Nov 03 07:52:05 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Creating offline snapshot e751cfff-6645-44cb-957c-4b43a521db51 of volume a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460ca61-634a-4480-9f20-b7982ea12b99]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 Nov 03 07:52:05 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02 Nov 03 07:52:05 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-aaa25c80-97a9-4fe0-bc1c-48033c760c02" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 1G Nov 03 07:52:05 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-aaa25c80-97a9-4fe0-bc1c-48033c760c02" released by "delete_volume" :: held 0.705s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Created reservations ['2b9b9bab-2bcf-4831-8e00-25e8ecaba9ff', '13c7dfc3-13ef-4a7c-82e2-7b1714966f46', '1b05ef43-a168-440e-8b24-45f2fc1a6f2b', '94950b27-28c3-47ae-a727-ef0c86a6fad5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:06 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:06 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:06 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Deleted volume successfully. Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffe8e482-3a57-456b-aa5e-5ea210d69dc9 tempest-ProjectReaderTests-480918553 None] Lock "cinder-aaa25c80-97a9-4fe0-bc1c-48033c760c02-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:06 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 1G" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:06 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 Nov 03 07:52:06 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:06 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:06 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 is being set with open permissions: ugo+rw Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:06 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 Nov 03 07:52:06 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (62e96033-179a-4492-8b11-d46e79303e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e405fd-722d-4114-8300-22181f0b2d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e405fd-722d-4114-8300-22181f0b2d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-428810234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0955c299-1bbb-439a-9ffb-06c00e0c7d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:07Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b0663f-04f0-4aab-bf64-b7d65bf00fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b0663f-04f0-4aab-bf64-b7d65bf00fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b21bb56-ae47-4321-95a5-5a27515dd725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b21bb56-ae47-4321-95a5-5a27515dd725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0955c299-1bbb-439a-9ffb-06c00e0c7d36', 'volume_name': 'volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2c66e6-ddad-42ba-95da-d6a011ac4fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2c66e6-ddad-42ba-95da-d6a011ac4fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f49c0f8-3c50-48ae-a697-80b048c93d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Volume 0955c299-1bbb-439a-9ffb-06c00e0c7d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36', 'volume_size': 1} Nov 03 07:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:07 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51" returned: 0 in 0.253s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:07 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info Nov 03 07:52:07 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:07 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:07 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info is being set with open permissions: ugo+rw Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:07 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info Nov 03 07:52:07 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:07 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.info" returned: 0 in 0.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-428810234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0955c299-1bbb-439a-9ffb-06c00e0c7d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:07Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Creating volume 0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:07 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:07 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 1073741824 Nov 03 07:52:07 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b99b8cb-8017-4223-9f8a-4635f3979f3d tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:52:08 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 1073741824" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:08 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 Nov 03 07:52:08 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:08 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36" returned: 0 in 0.241s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f49c0f8-3c50-48ae-a697-80b048c93d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590e2253-ae81-4e84-a4bc-145ab53f1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Volume volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 (0955c299-1bbb-439a-9ffb-06c00e0c7d36): created successfully Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590e2253-ae81-4e84-a4bc-145ab53f1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (62e96033-179a-4492-8b11-d46e79303e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-13cd9d7f-70c1-41f6-970c-c866583dcc9a tempest-ProjectReaderTests-480918553 None] Created volume successfully. Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-e751cfff-6645-44cb-957c-4b43a521db51-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Lock "cinder-e751cfff-6645-44cb-957c-4b43a521db51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-e751cfff-6645-44cb-957c-4b43a521db51" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-e751cfff-6645-44cb-957c-4b43a521db51" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot e751cfff-6645-44cb-957c-4b43a521db51 of volume a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa08b1e-3752-4f7b-88ad-6c26aebfee40]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:08 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 Nov 03 07:52:08 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Creating offline snapshot f4579061-32a8-4bfa-be89-519d357a71c4 of volume 0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9701936-e43d-4546-bdd6-5099e2f50de1]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5efb7-d659-4781-8457-0fe9e065c778]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 Nov 03 07:52:09 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 Nov 03 07:52:09 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 1G Nov 03 07:52:09 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 Nov 03 07:52:09 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 1G" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51 Nov 03 07:52:09 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 Nov 03 07:52:09 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8.e751cfff-6645-44cb-957c-4b43a521db51" returned: 0 in 0.246s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-e751cfff-6645-44cb-957c-4b43a521db51" released by "_delete_snapshot" :: held 1.431s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" released by "delete_snapshot" :: held 1.456s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:10 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 is being set with open permissions: ugo+rw Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Created reservations ['88426465-aeb9-46b1-ae19-2d3379a5b8fc', 'c436bbcd-8227-4e00-bfdc-160302bd2c8d', '002c6967-40fe-466a-a3bb-9a28d5ce8e20', '192660ca-ec9a-4dce-aa05-776e8dccc0be'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:10 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 Nov 03 07:52:10 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a44a56b9-c1a5-44de-a917-74238935e26c tempest-ProjectMemberTests-948307073 None] Lock "cinder-e751cfff-6645-44cb-957c-4b43a521db51-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:10 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:10 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info Nov 03 07:52:10 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info" returned: 0 in 0.234s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info is being set with open permissions: ugo+rw Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:10 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info Nov 03 07:52:10 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-a33e1e5b-0491-45f6-9d5d-1f6595782bd8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Lock "cinder-a33e1e5b-0491-45f6-9d5d-1f6595782bd8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30560d2-d648-4716-8ebd-70c3cc877011]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.info" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5d41e4e1-c830-4e8f-84bf-32cfb54bc507 tempest-ProjectReaderTests-480918553 None] Create snapshot completed successfully Nov 03 07:52:11 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 Nov 03 07:52:11 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-f4579061-32a8-4bfa-be89-519d357a71c4-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Lock "cinder-f4579061-32a8-4bfa-be89-519d357a71c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-0955c299-1bbb-439a-9ffb-06c00e0c7d36" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0955c299-1bbb-439a-9ffb-06c00e0c7d36" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-f4579061-32a8-4bfa-be89-519d357a71c4" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-f4579061-32a8-4bfa-be89-519d357a71c4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Deleting offline snapshot f4579061-32a8-4bfa-be89-519d357a71c4 of volume 0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] snapshot_file for this snap is: volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce1aa7-0bd3-45a8-911f-d9bf886d7b1a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8 Nov 03 07:52:11 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:11 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 Nov 03 07:52:11 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:11 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-a33e1e5b-0491-45f6-9d5d-1f6595782bd8" released by "delete_volume" :: held 0.664s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Created reservations ['ba35de9e-57d5-47c0-9e81-97860bd67bfc', '43367923-3a25-45c8-88c4-8f210abf2973', 'ffba2584-d914-44df-afc9-ae3c51245064', '956ece93-ab65-4e4e-8122-1d3d85310c63'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:11 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0fd50b-0bc5-4480-be48-9e509dda42ab]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:11 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:11 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 Nov 03 07:52:11 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3dd92d9e-1260-41b5-9db6-6e6c44a76396 tempest-ProjectMemberTests-948307073 None] Lock "cinder-a33e1e5b-0491-45f6-9d5d-1f6595782bd8-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:12 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:12 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 Nov 03 07:52:12 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (a90a11e4-d8a9-4f03-b5ea-fe52a3a0dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:12 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd270f99-3494-451e-b5a1-91404b94786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:12 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4 Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd270f99-3494-451e-b5a1-91404b94786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597081833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ebe26c-fbea-49d1-9e28-b3d5c359a473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:12Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:12 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26fda5-1fa3-48c1-a75e-054d9ea240b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26fda5-1fa3-48c1-a75e-054d9ea240b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cac5b30-c9f5-4f86-8c9e-3c79c59638c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cac5b30-c9f5-4f86-8c9e-3c79c59638c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ebe26c-fbea-49d1-9e28-b3d5c359a473', 'volume_name': 'volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970820e6-0a92-458a-a103-81f57ccac3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970820e6-0a92-458a-a103-81f57ccac3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b365c1-0091-4066-b7d5-56be4602e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Volume b3ebe26c-fbea-49d1-9e28-b3d5c359a473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473', 'volume_size': 1} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597081833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ebe26c-fbea-49d1-9e28-b3d5c359a473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:12Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Creating volume b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:12 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 1073741824 Nov 03 07:52:12 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36.f4579061-32a8-4bfa-be89-519d357a71c4" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-f4579061-32a8-4bfa-be89-519d357a71c4" released by "_delete_snapshot" :: held 1.501s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0955c299-1bbb-439a-9ffb-06c00e0c7d36" released by "delete_snapshot" :: held 1.529s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Created reservations ['6df7d282-730f-4a97-bd4f-abf92053ec31', '05290108-740e-4215-8ee9-6a9deb823387', 'bda51842-37aa-4c3a-b4c1-695d6638722f', '432f0b8c-2103-47ec-8a3f-137784831bba'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Delete snapshot completed successfully. Nov 03 07:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27baca51-ba6e-4231-a208-0574e1fe0c0b tempest-ProjectReaderTests-480918553 None] Lock "cinder-f4579061-32a8-4bfa-be89-519d357a71c4-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:13 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 1073741824" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:13 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 Nov 03 07:52:13 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:13 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" returned: 0 in 0.233s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b365c1-0091-4066-b7d5-56be4602e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89eead56-6262-4b1a-bafb-1a5a61ffb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Volume volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 (b3ebe26c-fbea-49d1-9e28-b3d5c359a473): created successfully Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89eead56-6262-4b1a-bafb-1a5a61ffb52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (a90a11e4-d8a9-4f03-b5ea-fe52a3a0dc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9ace79cb-8a69-4035-a4e0-415f2a91dc86 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-0955c299-1bbb-439a-9ffb-06c00e0c7d36-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Lock "cinder-0955c299-1bbb-439a-9ffb-06c00e0c7d36-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-0955c299-1bbb-439a-9ffb-06c00e0c7d36" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0955c299-1bbb-439a-9ffb-06c00e0c7d36" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6698c4-71f0-48e0-82fb-38451f610599]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:13 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 Nov 03 07:52:13 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Creating offline snapshot cbc2456a-7fce-40c8-9c25-ec34a39097fd of volume b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5659b-2f56-451c-b65d-97f106afa222]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:13 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 Nov 03 07:52:13 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:13 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:13 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36 Nov 03 07:52:13 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd 1G Nov 03 07:52:14 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-0955c299-1bbb-439a-9ffb-06c00e0c7d36" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-0955c299-1bbb-439a-9ffb-06c00e0c7d36" released by "delete_volume" :: held 0.699s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Created reservations ['b7e847a0-755e-4645-9f13-265ba1c9737e', '48939894-417f-44cb-8e29-4af99ef1f9b5', 'e25b3aec-6d8e-49ad-b367-e7655941a596', 'b01d79b9-5dd3-44f5-9428-70b45fb2f6dc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:14 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd 1G" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd Nov 03 07:52:14 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Deleted volume successfully. Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60ed428c-aedb-4abd-b131-d1198d071e5a tempest-ProjectReaderTests-480918553 None] Lock "cinder-0955c299-1bbb-439a-9ffb-06c00e0c7d36-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:14 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd is being set with open permissions: ugo+rw Nov 03 07:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd Nov 03 07:52:14 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (9a4dce92-53be-4fd9-82f2-740681f944a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a2e2a1-3a5d-4b04-a0f4-111c5a0a4a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a2e2a1-3a5d-4b04-a0f4-111c5a0a4a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1573150167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a508200-1ebd-47fb-aa01-20c3e62c69ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:15Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43986286-7907-4b6c-8384-e089ef45ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43986286-7907-4b6c-8384-e089ef45ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841aa0ed-cd29-497d-bebc-d1cb67e3deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841aa0ed-cd29-497d-bebc-d1cb67e3deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a508200-1ebd-47fb-aa01-20c3e62c69ef', 'volume_name': 'volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a507c2-1aac-44e4-9393-afb9f3a3cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a507c2-1aac-44e4-9393-afb9f3a3cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d899971b-c28c-476d-8392-c73044165722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Volume 7a508200-1ebd-47fb-aa01-20c3e62c69ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef', 'volume_size': 1} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd" returned: 0 in 0.289s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:15 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info Nov 03 07:52:15 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:15 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:15 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info is being set with open permissions: ugo+rw Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:15 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info Nov 03 07:52:15 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:15 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.info" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1573150167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a508200-1ebd-47fb-aa01-20c3e62c69ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:15Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Creating volume 7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:15 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef 1073741824 Nov 03 07:52:15 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1f8e1412-6340-408b-91f6-84db5a2d8cfe tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-cbc2456a-7fce-40c8-9c25-ec34a39097fd-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Lock "cinder-cbc2456a-7fce-40c8-9c25-ec34a39097fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-cbc2456a-7fce-40c8-9c25-ec34a39097fd" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-cbc2456a-7fce-40c8-9c25-ec34a39097fd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot cbc2456a-7fce-40c8-9c25-ec34a39097fd of volume b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[102168ac-0693-46ba-bc8e-2b4b33505a0a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:16 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd Nov 03 07:52:16 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:16 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef 1073741824" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:16 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef Nov 03 07:52:16 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:16 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d9b3d9-123f-4e19-aa6d-986c8e021f53]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:16 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d899971b-c28c-476d-8392-c73044165722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b9f03-62a4-45b0-ba52-5b04f8d48591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Volume volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef (7a508200-1ebd-47fb-aa01-20c3e62c69ef): created successfully Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b9f03-62a4-45b0-ba52-5b04f8d48591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (9a4dce92-53be-4fd9-82f2-740681f944a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-538269af-f073-4b93-99c9-6392e99a2470 tempest-ProjectReaderTests-480918553 None] Created volume successfully. Nov 03 07:52:16 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 Nov 03 07:52:16 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:16 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:16 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd Nov 03 07:52:16 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:17 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:17 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd Nov 03 07:52:17 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:17 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473.cbc2456a-7fce-40c8-9c25-ec34a39097fd" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Creating offline snapshot 973ccf26-7c12-438f-a92d-75a227c74f80 of volume 7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-cbc2456a-7fce-40c8-9c25-ec34a39097fd" released by "_delete_snapshot" :: held 1.484s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" released by "delete_snapshot" :: held 1.509s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985dbad-9bad-4fb1-836f-746c1cb78e57]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Created reservations ['112816d0-a39f-4b25-b566-58f7506d4cab', 'db221ae3-f138-40ea-b025-719ecbb9cd6c', 'fa9919c9-6b77-451a-b105-e1b23c8af960', '5e1c2e4e-530f-4c10-8eaa-87023a4b83f1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:17 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef Nov 03 07:52:17 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23baa237-44c9-485b-8f1d-35cd389674cd tempest-ProjectMemberTests-948307073 None] Lock "cinder-cbc2456a-7fce-40c8-9c25-ec34a39097fd-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:17 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:17 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 1G Nov 03 07:52:17 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-b3ebe26c-fbea-49d1-9e28-b3d5c359a473-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Lock "cinder-b3ebe26c-fbea-49d1-9e28-b3d5c359a473-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ba1bc-cc0f-4c50-8ded-1ca81f4b8c89]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 1G" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 Nov 03 07:52:18 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 Nov 03 07:52:18 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473 Nov 03 07:52:18 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 is being set with open permissions: ugo+rw Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 Nov 03 07:52:18 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-b3ebe26c-fbea-49d1-9e28-b3d5c359a473" released by "delete_volume" :: held 0.693s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:18 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Created reservations ['9f00bffe-4ae1-45f7-bfb5-1bf2ebff85f9', 'cbd7e399-a63d-44f2-8af4-8136dc58699d', '12f19c95-d1d5-41a7-8f9b-0ce45868a8e7', 'f53f5b30-45a3-4a8a-b280-8799d5285b2d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:18 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info Nov 03 07:52:18 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:18 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:19 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info is being set with open permissions: ugo+rw Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:19 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info Nov 03 07:52:19 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:19 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e675bd83-82a2-40d4-ad88-0321a140ee56 tempest-ProjectMemberTests-948307073 None] Lock "cinder-b3ebe26c-fbea-49d1-9e28-b3d5c359a473-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:19 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.info" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e89185a1-43b4-45be-b52e-256811bbe5b4 tempest-ProjectReaderTests-480918553 None] Create snapshot completed successfully Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (c92b712c-cac1-46c5-95ef-4a5127d66a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a987b1b-9a23-4b6f-a5a1-c5360f2ad306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a987b1b-9a23-4b6f-a5a1-c5360f2ad306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1950983879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878d3b93-8a37-4568-85ff-681329dfb87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:20Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e86395-6ffa-4d88-aac3-a2918bc7037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e86395-6ffa-4d88-aac3-a2918bc7037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc672fa-525c-441b-b379-518af537ad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc672fa-525c-441b-b379-518af537ad80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878d3b93-8a37-4568-85ff-681329dfb87a', 'volume_name': 'volume-878d3b93-8a37-4568-85ff-681329dfb87a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7db79b-fb8f-4bb9-b87f-b4e6fb17b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7db79b-fb8f-4bb9-b87f-b4e6fb17b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c616614-9667-417d-8434-ce7a83d4bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Volume 878d3b93-8a37-4568-85ff-681329dfb87a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878d3b93-8a37-4568-85ff-681329dfb87a', 'volume_size': 1} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1950983879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878d3b93-8a37-4568-85ff-681329dfb87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:20Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Creating volume 878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:19 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a 1073741824 Nov 03 07:52:19 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:20 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a 1073741824" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:20 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a Nov 03 07:52:20 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:20 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c616614-9667-417d-8434-ce7a83d4bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878d3b93-8a37-4568-85ff-681329dfb87a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eae9b83-ed22-4575-8814-a3845d333593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Volume volume-878d3b93-8a37-4568-85ff-681329dfb87a (878d3b93-8a37-4568-85ff-681329dfb87a): created successfully Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eae9b83-ed22-4575-8814-a3845d333593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (c92b712c-cac1-46c5-95ef-4a5127d66a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1dc5fd38-8153-457e-b8dc-d6e1bcc08557 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-973ccf26-7c12-438f-a92d-75a227c74f80-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Lock "cinder-973ccf26-7c12-438f-a92d-75a227c74f80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-7a508200-1ebd-47fb-aa01-20c3e62c69ef" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-7a508200-1ebd-47fb-aa01-20c3e62c69ef" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-973ccf26-7c12-438f-a92d-75a227c74f80" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-973ccf26-7c12-438f-a92d-75a227c74f80" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Deleting offline snapshot 973ccf26-7c12-438f-a92d-75a227c74f80 of volume 7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] snapshot_file for this snap is: volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0715d2f5-3089-4eb3-9a22-1164f2081c26]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:20 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 Nov 03 07:52:20 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Creating offline snapshot 14ab85ac-a641-42fe-aa1d-7f03a30482f0 of volume 878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843b447-f61a-4fd5-84f3-20b16a179d72]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:20 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:20 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a Nov 03 07:52:20 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a3e8ea-5228-4e4a-9476-c9a97a91f682]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef Nov 03 07:52:21 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a" returned: 0 in 0.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 1G Nov 03 07:52:21 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 Nov 03 07:52:21 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 1G" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878d3b93-8a37-4568-85ff-681329dfb87a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878d3b93-8a37-4568-85ff-681329dfb87a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 Nov 03 07:52:21 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80" returned: 0 in 0.347s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80 Nov 03 07:52:21 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878d3b93-8a37-4568-85ff-681329dfb87a -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 is being set with open permissions: ugo+rw Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 Nov 03 07:52:21 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef.973ccf26-7c12-438f-a92d-75a227c74f80" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-973ccf26-7c12-438f-a92d-75a227c74f80" released by "_delete_snapshot" :: held 1.452s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-7a508200-1ebd-47fb-aa01-20c3e62c69ef" released by "delete_snapshot" :: held 1.476s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Created reservations ['98591913-2d69-4f5f-8bcd-d4687f3f5a47', '71087d4f-2996-461b-bcc8-cc2059aeb1a7', 'b527f6d9-5d19-41e7-bdb4-99f0ea13d062', 'c7e072af-4236-4a89-b2dc-b9786c405337'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Delete snapshot completed successfully. Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a33d4be-0c56-4ad1-9c5b-e30c987ddee5 tempest-ProjectReaderTests-480918553 None] Lock "cinder-973ccf26-7c12-438f-a92d-75a227c74f80-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:22 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:22 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info Nov 03 07:52:22 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:22 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info is being set with open permissions: ugo+rw Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:22 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info Nov 03 07:52:22 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-7a508200-1ebd-47fb-aa01-20c3e62c69ef-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:22 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.info" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Lock "cinder-7a508200-1ebd-47fb-aa01-20c3e62c69ef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c102e242-0969-46d2-867e-5a608fc9e765 tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-7a508200-1ebd-47fb-aa01-20c3e62c69ef" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-7a508200-1ebd-47fb-aa01-20c3e62c69ef" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[36371758-d069-4f35-a464-5e1ed886b971]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:22 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef Nov 03 07:52:22 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-14ab85ac-a641-42fe-aa1d-7f03a30482f0-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Lock "cinder-14ab85ac-a641-42fe-aa1d-7f03a30482f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-878d3b93-8a37-4568-85ff-681329dfb87a" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-878d3b93-8a37-4568-85ff-681329dfb87a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-14ab85ac-a641-42fe-aa1d-7f03a30482f0" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-14ab85ac-a641-42fe-aa1d-7f03a30482f0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot 14ab85ac-a641-42fe-aa1d-7f03a30482f0 of volume 878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5549fb-26ec-4691-b903-7cc6cfa9c2ad]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef" returned: 0 in 0.364s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 Nov 03 07:52:23 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:23 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef Nov 03 07:52:23 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:23 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-7a508200-1ebd-47fb-aa01-20c3e62c69ef" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-878d3b93-8a37-4568-85ff-681329dfb87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-7a508200-1ebd-47fb-aa01-20c3e62c69ef" released by "delete_volume" :: held 0.714s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7903409-a87a-4d5b-90c6-f9581bb049b5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Created reservations ['b6ba6d89-3e13-4671-9723-0756eca3664e', '36573198-5081-455a-b3f0-222878d982ed', '36b431ec-fc9d-4d15-83ca-f49ed1053c24', 'd82f9723-e596-4cf8-9db7-62bb85a57a6b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:23 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a Nov 03 07:52:23 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:23 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:23 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:23 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Deleted volume successfully. Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e23243e8-e564-46cf-87bb-2f36b46e7571 tempest-ProjectReaderTests-480918553 None] Lock "cinder-7a508200-1ebd-47fb-aa01-20c3e62c69ef-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:23 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 Nov 03 07:52:23 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:24 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0 Nov 03 07:52:24 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (3c0b4765-0c7f-406b-9339-6c54c36d4556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425381dd-3170-44a5-b1b2-02bc671e6e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425381dd-3170-44a5-b1b2-02bc671e6e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667341318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961aec1a-437e-41d7-a8cf-c64549b6f0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:24Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b91f897-de24-4e85-ac98-90d49dd51123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b91f897-de24-4e85-ac98-90d49dd51123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92fe3b9-fa45-4aa0-bb31-3e458addfb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92fe3b9-fa45-4aa0-bb31-3e458addfb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961aec1a-437e-41d7-a8cf-c64549b6f0d6', 'volume_name': 'volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77097241-5c0d-4379-9291-d310dacc3ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77097241-5c0d-4379-9291-d310dacc3ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e11e7e-3ab8-48b2-ae4b-26dcac8c80e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Volume 961aec1a-437e-41d7-a8cf-c64549b6f0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6', 'volume_size': 1} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667341318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961aec1a-437e-41d7-a8cf-c64549b6f0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ed9f382de24ac09756c9fba577cf86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:24Z,use_quota=True,user_id='9f4a9b9fd22142229a6afa98c154d3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Creating volume 961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:24 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:24 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 1073741824 Nov 03 07:52:24 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a.14ab85ac-a641-42fe-aa1d-7f03a30482f0" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-14ab85ac-a641-42fe-aa1d-7f03a30482f0" released by "_delete_snapshot" :: held 1.522s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-878d3b93-8a37-4568-85ff-681329dfb87a" released by "delete_snapshot" :: held 1.552s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Created reservations ['fbc34dd8-4653-42f1-aa7a-29fb6e51c8a8', '054640f6-95d2-430f-854d-d971329ebca6', 'b699c514-aa05-4376-879e-fab6781618a7', 'd7b1ae99-f453-4daf-ba7b-0351e3ebd0a8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3cdb7a2f-a5d5-4bc3-85ad-c361e0444d87 tempest-ProjectMemberTests-948307073 None] Lock "cinder-14ab85ac-a641-42fe-aa1d-7f03a30482f0-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:24 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 1073741824" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:24 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 Nov 03 07:52:24 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:25 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e11e7e-3ab8-48b2-ae4b-26dcac8c80e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d84a50-0d76-40c9-b88d-5605f18dcbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-878d3b93-8a37-4568-85ff-681329dfb87a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Volume volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 (961aec1a-437e-41d7-a8cf-c64549b6f0d6): created successfully Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d84a50-0d76-40c9-b88d-5605f18dcbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Flow 'volume_create_manager' (3c0b4765-0c7f-406b-9339-6c54c36d4556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Lock "cinder-878d3b93-8a37-4568-85ff-681329dfb87a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-af2f69d0-8e76-47dd-a92d-7fe471996a35 tempest-ProjectReaderTests-480918553 None] Created volume successfully. Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-878d3b93-8a37-4568-85ff-681329dfb87a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-878d3b93-8a37-4568-85ff-681329dfb87a" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c276ca23-b4a1-4e80-854c-c5c538bf2b1c]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:25 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a Nov 03 07:52:25 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Creating offline snapshot 5858c70c-eda3-4f72-8a08-fe901e8bf743 of volume 961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a85af2a-1587-4776-b7a1-9e271ac8e172]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:25 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 Nov 03 07:52:25 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:25 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:25 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a Nov 03 07:52:25 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:25 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:25 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:25 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 1G Nov 03 07:52:25 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-878d3b93-8a37-4568-85ff-681329dfb87a" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-878d3b93-8a37-4568-85ff-681329dfb87a" released by "delete_volume" :: held 0.704s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Created reservations ['04cc85fe-052f-4aca-abd2-5a88216745b9', '6047fe3a-6190-489a-9e8a-e408b792635c', '3c391a3c-7833-4306-9987-ad5f7966fddf', '48d9fa3e-6634-4598-881e-1a464e44b933'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:26 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 1G" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:26 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 Nov 03 07:52:26 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07cb74e9-c6b6-4287-b0eb-540b5a2186b5 tempest-ProjectMemberTests-948307073 None] Lock "cinder-878d3b93-8a37-4568-85ff-681329dfb87a-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:26 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743" returned: 0 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 is being set with open permissions: ugo+rw Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 Nov 03 07:52:26 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (535f39a9-02c2-4401-9c96-d5f50f2a8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d8771e-2827-43af-8918-8fbb67039bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d8771e-2827-43af-8918-8fbb67039bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610607128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b034319-6a29-409b-b677-521749b90441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:27Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df585430-36e1-4a82-b6ce-6e92452cab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df585430-36e1-4a82-b6ce-6e92452cab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955f9a88-4f33-4d12-9738-5a1a06791977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955f9a88-4f33-4d12-9738-5a1a06791977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b034319-6a29-409b-b677-521749b90441', 'volume_name': 'volume-2b034319-6a29-409b-b677-521749b90441', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc46a2bc-5981-4201-aa20-90c3eab6f93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc46a2bc-5981-4201-aa20-90c3eab6f93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd1408-f883-449e-8f7c-d1cc5bdf6018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Volume 2b034319-6a29-409b-b677-521749b90441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b034319-6a29-409b-b677-521749b90441', 'volume_size': 1} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:26 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info Nov 03 07:52:26 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:27 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info" returned: 0 in 0.233s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:27 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info is being set with open permissions: ugo+rw Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:27 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info Nov 03 07:52:27 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:27 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.info" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610607128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b034319-6a29-409b-b677-521749b90441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:27Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Creating volume 2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:27 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 1073741824 Nov 03 07:52:27 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-49772fe3-d74a-46ef-8898-6a7f441ae499 tempest-ProjectReaderTests-480918553 None] Create snapshot completed successfully Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-5858c70c-eda3-4f72-8a08-fe901e8bf743-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Lock "cinder-5858c70c-eda3-4f72-8a08-fe901e8bf743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-961aec1a-437e-41d7-a8cf-c64549b6f0d6" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-961aec1a-437e-41d7-a8cf-c64549b6f0d6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-5858c70c-eda3-4f72-8a08-fe901e8bf743" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-5858c70c-eda3-4f72-8a08-fe901e8bf743" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Deleting offline snapshot 5858c70c-eda3-4f72-8a08-fe901e8bf743 of volume 961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] snapshot_file for this snap is: volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e599627d-2143-4737-a1a4-10c55eaf3b2f]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:27 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 Nov 03 07:52:27 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:27 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 1073741824" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:27 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 Nov 03 07:52:27 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374cb6a-9f84-4b7e-908a-5c251540f4e3]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:28 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd1408-f883-449e-8f7c-d1cc5bdf6018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b034319-6a29-409b-b677-521749b90441', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f860540-a5c0-47bc-8645-e902fbf53538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Volume volume-2b034319-6a29-409b-b677-521749b90441 (2b034319-6a29-409b-b677-521749b90441): created successfully Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f860540-a5c0-47bc-8645-e902fbf53538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:28 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 Nov 03 07:52:28 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (535f39a9-02c2-4401-9c96-d5f50f2a8a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e3c4367e-0354-486a-8639-8e222a775267 tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:52:28 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:28 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 Nov 03 07:52:28 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:28 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743 Nov 03 07:52:28 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=219,cinder:INSERT=77,cinder:UPDATE=273,cinder:DELETE=20 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Creating offline snapshot 881dc08a-6ae7-43b0-8827-131b2dc622d2 of volume 2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:29 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6.5858c70c-eda3-4f72-8a08-fe901e8bf743" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[84224fea-0f5f-4d8f-b5b2-63082033989d]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-5858c70c-eda3-4f72-8a08-fe901e8bf743" released by "_delete_snapshot" :: held 1.445s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-961aec1a-437e-41d7-a8cf-c64549b6f0d6" released by "delete_snapshot" :: held 1.473s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Created reservations ['70511712-245e-472c-af25-8a1bfb44aa9e', 'd1ee34b2-055e-432e-8ff1-df6673eb7b81', '881a83a6-db33-4a02-937c-a7542caa2e27', '9fbb2394-2abf-44b0-83ba-99949179cd10'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:29 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 Nov 03 07:52:29 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Delete snapshot completed successfully. Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-40aa6940-52dd-4d98-a139-d4d0cf1694fb tempest-ProjectReaderTests-480918553 None] Lock "cinder-5858c70c-eda3-4f72-8a08-fe901e8bf743-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:29 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:29 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 1G Nov 03 07:52:29 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-961aec1a-437e-41d7-a8cf-c64549b6f0d6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Lock "cinder-961aec1a-437e-41d7-a8cf-c64549b6f0d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=70,cinder:UPDATE=268,cinder:SELECT=194,cinder:DELETE=26 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Acquiring lock "cinder-quobyte-961aec1a-437e-41d7-a8cf-c64549b6f0d6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-961aec1a-437e-41d7-a8cf-c64549b6f0d6" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:29 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3bb9db-d77a-4ca1-b837-542d39fcf5bf]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 1G" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b034319-6a29-409b-b677-521749b90441 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:29 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b034319-6a29-409b-b677-521749b90441 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 Nov 03 07:52:29 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:29 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 Nov 03 07:52:29 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b034319-6a29-409b-b677-521749b90441 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2" returned: 0 in 0.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 is being set with open permissions: ugo+rw Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 Nov 03 07:52:30 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6 Nov 03 07:52:30 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info Nov 03 07:52:30 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-961aec1a-437e-41d7-a8cf-c64549b6f0d6" returned: 0 in 0.240s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Lock "cinder-quobyte-961aec1a-437e-41d7-a8cf-c64549b6f0d6" released by "delete_volume" :: held 0.669s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Created reservations ['7472c48a-d98d-4b7a-ab41-7030bc4b3735', 'c8e6594e-154c-4f36-b9c7-e184e4f77f77', '4704984e-c079-46cf-94bf-97b9494936ba', '70ec14f8-dde1-4dc1-aa61-e3375a017153'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:30 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info is being set with open permissions: ugo+rw Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info Nov 03 07:52:30 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Deleted volume successfully. Nov 03 07:52:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bf7cfcb-b94d-4322-bdd2-2a1b785ea661 tempest-ProjectReaderTests-480918553 None] Lock "cinder-961aec1a-437e-41d7-a8cf-c64549b6f0d6-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:31 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.info" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ed379631-2e91-47c9-a9b0-9b06f280bc08 tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-881dc08a-6ae7-43b0-8827-131b2dc622d2-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-881dc08a-6ae7-43b0-8827-131b2dc622d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-2b034319-6a29-409b-b677-521749b90441" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-2b034319-6a29-409b-b677-521749b90441" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-881dc08a-6ae7-43b0-8827-131b2dc622d2" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-881dc08a-6ae7-43b0-8827-131b2dc622d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot 881dc08a-6ae7-43b0-8827-131b2dc622d2 of volume 2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e435fd-1162-40a7-b33c-39284b907913]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:32 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 Nov 03 07:52:32 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:32 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b034319-6a29-409b-b677-521749b90441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae04ee2a-ceec-4136-825e-6133e5e19c97]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:32 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 Nov 03 07:52:32 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:33 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 Nov 03 07:52:33 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:33 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2 Nov 03 07:52:33 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441.881dc08a-6ae7-43b0-8827-131b2dc622d2" returned: 0 in 0.253s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-881dc08a-6ae7-43b0-8827-131b2dc622d2" released by "_delete_snapshot" :: held 1.475s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-2b034319-6a29-409b-b677-521749b90441" released by "delete_snapshot" :: held 1.505s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Created reservations ['ffef5002-3d97-4fd7-8f7d-0768ef626e4e', '562cf7a5-4463-4bba-9d7f-95131c407f18', '69e76538-dc19-495e-bd86-a95fcc66396f', 'bc837206-a6df-4a56-ab94-b189afff0a5a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:52:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e28f0ec3-5095-4c14-9124-840bbc1a25b8 tempest-ProjectMemberTests-948307073 None] Lock "cinder-881dc08a-6ae7-43b0-8827-131b2dc622d2-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-2b034319-6a29-409b-b677-521749b90441-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Lock "cinder-2b034319-6a29-409b-b677-521749b90441-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-2b034319-6a29-409b-b677-521749b90441" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-2b034319-6a29-409b-b677-521749b90441" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db102a6-3c30-4512-af37-ec6e9fe93685]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:34 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 Nov 03 07:52:34 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:34 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:34 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441 Nov 03 07:52:34 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:35 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-2b034319-6a29-409b-b677-521749b90441" returned: 0 in 0.232s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-2b034319-6a29-409b-b677-521749b90441" released by "delete_volume" :: held 0.660s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Created reservations ['01b9dd1f-7730-43e6-8451-f39fbc73b46f', 'cf280c60-3a5b-43ab-8856-51491475db5b', 'af5d420d-91d6-4263-9d78-15d0631050fb', 'cacd2830-e6fb-47fd-b20a-00665f602812'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:35 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:35 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:35 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.248s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c2e628f3-6b07-4339-a329-fc7e5533c51a tempest-ProjectMemberTests-948307073 None] Lock "cinder-2b034319-6a29-409b-b677-521749b90441-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (990a6d76-17ea-4d74-97b7-6b58b1adc707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e277821a-b196-4b36-a6ba-f259806ff15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e277821a-b196-4b36-a6ba-f259806ff15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751520191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:36Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191c59f5-b2d9-4afa-898c-77fcd216fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191c59f5-b2d9-4afa-898c-77fcd216fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87bd601-4620-4e40-b3cd-9e31960d6d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87bd601-4620-4e40-b3cd-9e31960d6d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee', 'volume_name': 'volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaaf2c6-5edd-4ebc-8e41-69435f9e3263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaaf2c6-5edd-4ebc-8e41-69435f9e3263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5474487-203c-4e89-a4fe-7b851801a389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Volume 5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee', 'volume_size': 1} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751520191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2464c715935b45089cd63f2f37117d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:36Z,use_quota=True,user_id='f97541e6f12c4f04bfaa33641feb40ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Creating volume 5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:36 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee 1073741824 Nov 03 07:52:36 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:36 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee 1073741824" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:36 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee Nov 03 07:52:36 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:36 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5474487-203c-4e89-a4fe-7b851801a389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f02847-202c-46aa-909c-7c7c5ca847c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Volume volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee (5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee): created successfully Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f02847-202c-46aa-909c-7c7c5ca847c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Flow 'volume_create_manager' (990a6d76-17ea-4d74-97b7-6b58b1adc707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c853190b-b9b5-4173-acc7-8fe4d0b533ab tempest-ProjectMemberTests-948307073 None] Created volume successfully. Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Creating offline snapshot 77098e9f-0f5b-420e-9082-1bf59c17fa3e of volume 5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f5c4a-1090-4492-b12f-c0242d177eb7]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:37 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee Nov 03 07:52:37 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:37 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" returned: 0 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:37 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e 1G Nov 03 07:52:37 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:37 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e 1G" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:37 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e Nov 03 07:52:37 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:38 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e is being set with open permissions: ugo+rw Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:38 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e Nov 03 07:52:38 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:38 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:38 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info Nov 03 07:52:38 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:38 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info is being set with open permissions: ugo+rw Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:38 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info Nov 03 07:52:38 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:38 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.info" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e3442ee-c868-473c-aec5-3a1b429f0f9a tempest-ProjectMemberTests-948307073 None] Create snapshot completed successfully Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-77098e9f-0f5b-420e-9082-1bf59c17fa3e-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Lock "cinder-77098e9f-0f5b-420e-9082-1bf59c17fa3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-77098e9f-0f5b-420e-9082-1bf59c17fa3e" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-77098e9f-0f5b-420e-9082-1bf59c17fa3e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Deleting offline snapshot 77098e9f-0f5b-420e-9082-1bf59c17fa3e of volume 5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] snapshot_file for this snap is: volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f70db-7fca-4215-a5ba-2e14df0e9cf5]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:39 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e Nov 03 07:52:39 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:39 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4afeaeb-47fc-48a2-a84d-331fe0186802]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:39 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee Nov 03 07:52:39 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:40 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:40 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e Nov 03 07:52:40 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:40 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:40 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e Nov 03 07:52:40 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:40 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee.77098e9f-0f5b-420e-9082-1bf59c17fa3e" returned: 0 in 0.247s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-77098e9f-0f5b-420e-9082-1bf59c17fa3e" released by "_delete_snapshot" :: held 1.412s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" released by "delete_snapshot" :: held 1.436s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Created reservations ['6fbfc424-da7d-4fc0-93de-91e7d34a2bea', '50586d44-c264-4eca-ac9e-76ff9e416a4b', '571dd0a5-ad4d-4e4c-9731-96e1bf8cf1a3', 'a19f7c7b-c182-4edf-a4be-e88e27587423'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Delete snapshot completed successfully. Nov 03 07:52:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d16b17b-d67c-418a-8bc5-183e4b67ad1f tempest-ProjectMemberTests-948307073 None] Lock "cinder-77098e9f-0f5b-420e-9082-1bf59c17fa3e-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Lock "cinder-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Acquiring lock "cinder-quobyte-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe71fe5-811f-4dfd-a75e-001fd4e4a2da]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:41 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee Nov 03 07:52:41 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:41 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:41 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee Nov 03 07:52:41 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:42 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Lock "cinder-quobyte-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee" released by "delete_volume" :: held 0.655s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Created reservations ['6d6d82fe-2f0a-421a-8e83-4848ad129e31', '2fd3c0f6-ccad-421f-b616-9b876a19fbbf', 'ed122b3a-5a86-4ef2-8969-b1389cc5487d', '3e02096e-8e46-45eb-accb-3c9fc9d70b3a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:42 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:42 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:42 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Deleted volume successfully. Nov 03 07:52:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d4089f6-bca9-4bfd-b87c-f4f81cea7887 tempest-ProjectMemberTests-948307073 None] Lock "cinder-5efef5da-4a76-4f9c-bbbb-fc0d5f5596ee-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:52 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=33,cinder:INSERT=11,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:52 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=32,cinder:UPDATE=44,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:54 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:52:54 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:54 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:52:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Flow 'volume_create_manager' (43aade0c-d4d5-44df-96b6-84440b689b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371578c8-0925-4987-ac09-f646cf335d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371578c8-0925-4987-ac09-f646cf335d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-767888651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028bea0e-8d90-4625-a918-8d64b2d41141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a49e76701947728d83dd524048f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:53:10Z,use_quota=True,user_id='bb54af328c7949289f1577196de4b832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98ece8f-10d2-4464-83e3-e1777fd3544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98ece8f-10d2-4464-83e3-e1777fd3544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5016f-c8cd-4ddc-8181-59038373341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5016f-c8cd-4ddc-8181-59038373341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028bea0e-8d90-4625-a918-8d64b2d41141', 'volume_name': 'volume-028bea0e-8d90-4625-a918-8d64b2d41141', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91a485a-76a4-4bb2-b9f8-b6df8016ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91a485a-76a4-4bb2-b9f8-b6df8016ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8a6f37-d9e5-48a6-9b67-df18adccd494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Volume 028bea0e-8d90-4625-a918-8d64b2d41141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028bea0e-8d90-4625-a918-8d64b2d41141', 'volume_size': 1} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-767888651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028bea0e-8d90-4625-a918-8d64b2d41141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a49e76701947728d83dd524048f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:53:10Z,use_quota=True,user_id='bb54af328c7949289f1577196de4b832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Creating volume 028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:53:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] casted to osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:10 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 1073741824 Nov 03 07:53:10 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:10 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 1073741824" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:10 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 Nov 03 07:53:10 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:11 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8a6f37-d9e5-48a6-9b67-df18adccd494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028bea0e-8d90-4625-a918-8d64b2d41141', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07cf923-33ef-4cef-92e1-e6787228fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Volume volume-028bea0e-8d90-4625-a918-8d64b2d41141 (028bea0e-8d90-4625-a918-8d64b2d41141): created successfully Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07cf923-33ef-4cef-92e1-e6787228fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Flow 'volume_create_manager' (43aade0c-d4d5-44df-96b6-84440b689b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:53:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e1f465b-4309-42a9-befe-bc334d04b3fa tempest-SnapshotDependencyTests-25720858 None] Created volume successfully. Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Creating offline snapshot 7401a542-535a-4297-bfaa-8608b77cb5ac of volume 028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d597b35-7d3f-4618-879c-db5ad5a77bad]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:11 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 Nov 03 07:53:11 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:11 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:11 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac 1G Nov 03 07:53:11 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:12 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac 1G" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028bea0e-8d90-4625-a918-8d64b2d41141 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:12 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028bea0e-8d90-4625-a918-8d64b2d41141 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac Nov 03 07:53:12 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:12 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028bea0e-8d90-4625-a918-8d64b2d41141 -F qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac is being set with open permissions: ugo+rw Nov 03 07:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:12 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac Nov 03 07:53:12 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:12 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac" returned: 0 in 0.226s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:12 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info Nov 03 07:53:12 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:13 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info is being set with open permissions: ugo+rw Nov 03 07:53:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:13 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info Nov 03 07:53:13 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:13 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.info" returned: 0 in 0.234s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4b39736f-950b-461b-9da3-81ccbe3c3c25 tempest-SnapshotDependencyTests-25720858 None] Create snapshot completed successfully Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Flow 'volume_create_manager' (6875073d-7f02-4c0e-8d8d-e8bb9a55aaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac07e18-6757-4a13-ad59-eeee426b76b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac07e18-6757-4a13-ad59-eeee426b76b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325caaca-9807-4294-a1e6-f0be15e84d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a49e76701947728d83dd524048f130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7401a542-535a-4297-bfaa-8608b77cb5ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:53:14Z,use_quota=True,user_id='bb54af328c7949289f1577196de4b832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dcd24c3-6774-4aad-99ad-0cc690aad74d),volume_type_id=8dcd24c3-6774-4aad-99ad-0cc690aad74d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf45719b-9a08-42f0-87b6-f5071122b5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf45719b-9a08-42f0-87b6-f5071122b5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b1559-6ac3-44ff-8594-39cb0e9e7843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b1559-6ac3-44ff-8594-39cb0e9e7843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '325caaca-9807-4294-a1e6-f0be15e84d8a', 'volume_name': 'volume-325caaca-9807-4294-a1e6-f0be15e84d8a', 'volume_size': 1, 'snapshot_id': '7401a542-535a-4297-bfaa-8608b77cb5ac'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8fa44d-d736-43c8-a60f-b5c593a5ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8fa44d-d736-43c8-a60f-b5c593a5ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2fe11b-920a-4207-b4ab-84faf622d47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Volume 325caaca-9807-4294-a1e6-f0be15e84d8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-325caaca-9807-4294-a1e6-f0be15e84d8a', 'volume_size': 1, 'snapshot_id': '7401a542-535a-4297-bfaa-8608b77cb5ac'} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-quobyte-7401a542-535a-4297-bfaa-8608b77cb5ac-325caaca-9807-4294-a1e6-f0be15e84d8a" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-7401a542-535a-4297-bfaa-8608b77cb5ac-325caaca-9807-4294-a1e6-f0be15e84d8a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Creating volume 325caaca-9807-4294-a1e6-f0be15e84d8a from snapshot 7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Selected osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-quobyte-325caaca-9807-4294-a1e6-f0be15e84d8a" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-325caaca-9807-4294-a1e6-f0be15e84d8a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] snapshot: 7401a542-535a-4297-bfaa-8608b77cb5ac, volume: 325caaca-9807-4294-a1e6-f0be15e84d8a, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c324f158-1213-4380-8e17-c0519e676f4e]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:14 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac Nov 03 07:53:14 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:14 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028bea0e-8d90-4625-a918-8d64b2d41141(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d739b05e-1f10-4e5d-a3c4-33fe239cc65a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:14 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 Nov 03 07:53:14 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:15 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:53:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:53:15 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Path /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:53:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:15 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a Nov 03 07:53:15 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:20 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a" returned: 0 in 5.615s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Image conversion details: src /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:53:20 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Converted 1024.00 MB image at 182.34 MB/s Nov 03 07:53:20 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a is being set with open permissions: ugo+rw Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:20 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a Nov 03 07:53:20 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:20 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-325caaca-9807-4294-a1e6-f0be15e84d8a" released by "_copy_volume_from_snapshot" :: held 6.633s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-7401a542-535a-4297-bfaa-8608b77cb5ac-325caaca-9807-4294-a1e6-f0be15e84d8a" released by "_create_volume_from_snapshot" :: held 6.694s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.712s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2fe11b-920a-4207-b4ab-84faf622d47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325caaca-9807-4294-a1e6-f0be15e84d8a', 'volume_size': 1, 'snapshot_id': '7401a542-535a-4297-bfaa-8608b77cb5ac'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fcdc49-673d-469e-909d-f91cd0869bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:53:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Volume volume-325caaca-9807-4294-a1e6-f0be15e84d8a (325caaca-9807-4294-a1e6-f0be15e84d8a): created successfully Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fcdc49-673d-469e-909d-f91cd0869bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Flow 'volume_create_manager' (6875073d-7f02-4c0e-8d8d-e8bb9a55aaa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:53:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-915acabb-4d3a-4b11-9cb6-44b7e781af63 tempest-SnapshotDependencyTests-25720858 None] Created volume successfully. Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-7401a542-535a-4297-bfaa-8608b77cb5ac-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-7401a542-535a-4297-bfaa-8608b77cb5ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-quobyte-028bea0e-8d90-4625-a918-8d64b2d41141" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-028bea0e-8d90-4625-a918-8d64b2d41141" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-quobyte-7401a542-535a-4297-bfaa-8608b77cb5ac" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-7401a542-535a-4297-bfaa-8608b77cb5ac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Deleting offline snapshot 7401a542-535a-4297-bfaa-8608b77cb5ac of volume 028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] snapshot_file for this snap is: volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c27af-5ead-4c7f-a9f7-57d8c4146042]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:21 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac Nov 03 07:53:21 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:22 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028bea0e-8d90-4625-a918-8d64b2d41141(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:53:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1ffe72-ffb0-4347-83da-84c17705df44]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:22 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 Nov 03 07:53:22 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:22 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141" returned: 0 in 0.504s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:22 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac Nov 03 07:53:22 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:23 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:23 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac Nov 03 07:53:23 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:23 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141.7401a542-535a-4297-bfaa-8608b77cb5ac" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-7401a542-535a-4297-bfaa-8608b77cb5ac" released by "_delete_snapshot" :: held 1.497s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-028bea0e-8d90-4625-a918-8d64b2d41141" released by "delete_snapshot" :: held 1.519s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Created reservations ['ce9388d5-203e-41c7-b3e0-eda4a344e9f8', '257b5941-df65-4680-a8dd-1779901f63b8', '5d5dc217-9413-41bf-92d0-673661328228', '9597cccb-dd59-44f1-9454-aea40964032a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:53:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Delete snapshot completed successfully. Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-308a3fe5-d5a6-4f35-9d88-22137edcacad tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-7401a542-535a-4297-bfaa-8608b77cb5ac-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-028bea0e-8d90-4625-a918-8d64b2d41141-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-028bea0e-8d90-4625-a918-8d64b2d41141-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-quobyte-028bea0e-8d90-4625-a918-8d64b2d41141" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-028bea0e-8d90-4625-a918-8d64b2d41141" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e493508-eb0b-48a4-96e9-1d362b76312a]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:24 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 Nov 03 07:53:24 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:24 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141" returned: 0 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:24 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141 Nov 03 07:53:24 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:24 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-028bea0e-8d90-4625-a918-8d64b2d41141" returned: 0 in 0.241s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-028bea0e-8d90-4625-a918-8d64b2d41141" released by "delete_volume" :: held 0.664s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Created reservations ['72cf5c65-c563-4f3a-a7be-5de7a3356d04', '5e2e537b-28f9-4ae6-82b7-0189ce117319', 'cbf8cd3b-28c5-4ce2-ba6f-e01dc8b99707', '2c1329db-21eb-4017-8786-066d1543c296'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:24 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:53:24 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:25 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.247s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:53:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Deleted volume successfully. Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5eccd62-85af-48ba-ade6-1deb83976fc1 tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-028bea0e-8d90-4625-a918-8d64b2d41141-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-325caaca-9807-4294-a1e6-f0be15e84d8a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-325caaca-9807-4294-a1e6-f0be15e84d8a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "cinder-quobyte-325caaca-9807-4294-a1e6-f0be15e84d8a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-325caaca-9807-4294-a1e6-f0be15e84d8a" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab19e2d-a8de-489a-942d-863651aadcd6]: (4, 'qcow2') {{(pid=88158) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:25 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a Nov 03 07:53:25 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:25 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a" returned: 0 in 0.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:25 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a Nov 03 07:53:25 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:25 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a/volume-325caaca-9807-4294-a1e6-f0be15e84d8a" returned: 0 in 0.237s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-quobyte-325caaca-9807-4294-a1e6-f0be15e84d8a" released by "delete_volume" :: held 0.634s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Created reservations ['4f7c2289-c438-4db1-8fb2-62a1d7e531d2', 'dae4c655-6320-4667-bed8-be819467aa3b', 'b2180d74-f394-4417-b265-26b97009f776', 'd2b4ab9a-79d3-4e74-835e-70c752b25706'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:25 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:53:25 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:26 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:53:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Deleted volume successfully. Nov 03 07:53:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3c95c4e-823d-4aa0-92f3-e42f0bb128bc tempest-SnapshotDependencyTests-25720858 None] Lock "cinder-325caaca-9807-4294-a1e6-f0be15e84d8a-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:53:35 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=27 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:53:36 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=31,cinder:DELETE=5,cinder:SELECT=23,cinder:INSERT=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4625925a-27b7-4f6b-b403-96238639ec47'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:54 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a Nov 03 07:53:54 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:54 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6315fe83f7437eaee7e0f6adea6b6f6a" returned: 0 in 0.232s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:53:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00cf852c-637b-4019-8857-15a04ec8315f None None] thread info: [<_MainThread(MainThread, started 127256421335168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}